-- Logs begin at Tue 2022-06-21 15:40:00 UTC, end at Tue 2022-06-21 17:08:13 UTC. -- Jun 21 16:27:23.062612 dv-cinder-799871-21-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 16:27:23.072280 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 16:27:23 2022] *** Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: nodename: dv-cinder-799871-21-iscsi Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: machine: x86_64 Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: clock source: unix Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: pcre jit disabled Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: detected number of CPU cores: 4 Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: current working directory: / Jun 21 16:27:23.074401 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: detected binary path: /usr/bin/uwsgi-core Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: your processes number limit is 47680 Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: your memory page size is 4096 bytes Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: detected max file descriptor number: 2048 Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: lock engine: pthread robust mutexes Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: thunder lock: enabled Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 16:27:23.075043 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 16:27:23.119941 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: Python main interpreter initialized at 0x55b8d15029c0 Jun 21 16:27:23.119941 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: python threads support enabled Jun 21 16:27:23.119941 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: your server socket listen backlog is limited to 100 connections Jun 21 16:27:23.119941 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: your mercy for graceful operations on workers is 90 seconds Jun 21 16:27:23.120305 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 16:27:23.120407 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: *** Operational MODE: preforking *** Jun 21 16:27:23.120664 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: *** uWSGI is running in multiple interpreter mode *** Jun 21 16:27:23.120664 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: spawned uWSGI master process (pid: 80598) Jun 21 16:27:23.120876 dv-cinder-799871-21-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 16:27:23.122303 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: spawned uWSGI worker 1 (pid: 80609, cores: 1) Jun 21 16:27:23.122303 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: spawned uWSGI worker 2 (pid: 80610, cores: 1) Jun 21 16:27:23.122303 dv-cinder-799871-21-iscsi devstack@keystone.service[80598]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 16:27:28.694873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:27:28.694873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: from cryptography.utils import int_from_bytes Jun 21 16:27:28.695682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:27:28.695682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: from cryptography.utils import int_from_bytes Jun 21 16:27:28.698371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:27:28.698371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: from cryptography.utils import int_from_bytes Jun 21 16:27:28.698832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:27:28.698832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: from cryptography.utils import int_from_bytes Jun 21 16:27:28.745048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 16:27:28.745373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 16:27:28.745492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] command line args: [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 16:27:28.745745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 16:27:28.745931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ================================================================================ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 16:27:28.746198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] admin_token = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.746348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 16:27:28.746437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] config_dir = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.746562 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 16:27:28.746651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.746760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] command line args: [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 16:27:28.746846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] config_source = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.746973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] debug = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.747065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 16:27:28.747178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.747493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ================================================================================ {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 16:27:28.747493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] admin_token = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.747694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.747798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] config_dir = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.747907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] config_source = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] debug = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_config_append = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.748991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_dir = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.749929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_config_append = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_dir = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_file = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.750959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.751917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.752915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.753100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.753354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] publish_errors = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.753588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.753706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.753850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.753966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] publish_errors = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] standard_threads = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.754949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] use_journal = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] use_json = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] use_stderr = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] standard_threads = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.755862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] use_syslog = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.756441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.756624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] use_journal = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.756838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] use_json = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.756993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] use_stderr = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.757082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.757161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] use_syslog = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.757234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.757430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:27:28.757512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.757697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.757782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.757951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.758787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.759506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.759637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.759803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.759895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.760907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.761936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.762937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.763895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.764876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.765896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.766922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.767937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.768995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.769981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.770875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.771970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.772990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.773921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.774921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.775971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.776926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.777943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.778881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.779984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.780934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.external = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.781979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.password = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.782972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] auth.token = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783368 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.external = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.783925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.password = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.784891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] auth.token = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.785874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.786849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.787833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.788856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.789864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.790929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.791965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.792980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.793998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794473 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.794987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.795995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.796972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.797980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.798938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.799908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.800880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.801856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.802980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.803952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.804987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.805145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.805231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.805417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.805498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.806961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.807985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.808921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.809901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.810059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.810145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.811968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.812984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.813892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.814865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.815871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.816974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] role.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] role.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817479 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.817961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] role.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] role.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.818949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.819937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.820936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.821098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.821178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.821465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.822092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.822274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.822376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.822584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.822791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.822870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.823879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.824834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.825988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.826957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.827927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.828990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.829987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.830967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.831949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.connection = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.832999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.833911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.834978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.835919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.836062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 16:27:28.836139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.836315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:27:28.836490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 16:27:28.866831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.867059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.867285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.867422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.867678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.867911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.876439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.876953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.904932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.905165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.905260 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:28.905515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.047234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.048677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.095994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.096230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.098455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.098696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.160570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.160806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.161925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.162148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.162368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.188975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.189107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.189199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.189346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.189431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.189579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.200580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.201071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.213263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.213518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.213750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.213977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.214882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.215103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.215324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 16:27:29.232535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.232745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 16:27:29.232841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.232961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 16:27:29.233083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.233295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 16:27:29.233382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.233523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 16:27:29.233615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.233801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.233886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.234071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.234161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.234329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.234412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.234601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.245604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.245882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.246153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.246275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.246437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.246555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.246825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.247110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.254696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.255441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.258795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.259304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.261879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.264139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.264988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.265056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.265120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.265120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.265120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.288728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.288911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.291073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.291176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.291356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.291442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.296614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.296982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.297078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.297420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.297513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.297688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.304640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.304919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.305006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.305240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.310082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.313157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.313398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.313991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.314067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.314142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.314142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.314142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.330704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.330983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.332848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.333129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.335798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.338537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.339952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.340408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.342246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.342647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.345449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.347649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.349316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.351631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.353530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.353830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.354112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.354396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.354674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.354950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.356058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.356361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.356651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.356937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.357232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.357541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.373950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.374232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.374511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.374776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.376702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.376991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.377262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.377582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.382659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.384486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.384760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.385594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.387302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.387603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.388027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.388309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.388655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.388942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.389232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.390817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.391106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.391391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.391682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.391964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.402929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.403210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.403501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.403784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.405445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.405746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.405859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.406084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.406176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.406410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.406695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.408355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.408654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.408950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.424435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.427401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.427741 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.430856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.431272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.433142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.434547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.434807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.435087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.435377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.436280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.438032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.438311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.438596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.442973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.444574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.445936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.447711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.447857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.448147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.448539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.448819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.451013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.451349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.451742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.452025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.457897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.458183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.458464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.462413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.462816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.463190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.466808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.467092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.467374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.467649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.467921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.468293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.468571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.468864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.469136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.469437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.469713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.469976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.470251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.470530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.471885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 16:27:29.472189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.472491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.472787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.473365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.473787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.474082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.474374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.474698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.475031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.475339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.475643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.475967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.476273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 16:27:29.508687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8d15029c0 pid: 80609 (default app) Jun 21 16:27:29.513066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd72a-e2ef-428d-956a-f9ff8a1c7900 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:29.513393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd72a-e2ef-428d-956a-f9ff8a1c7900 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:29.513680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd72a-e2ef-428d-956a-f9ff8a1c7900 None None] PATH_INFO: `/v3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:29.514997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8d15029c0 pid: 80610 (default app) Jun 21 16:27:29.517898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Tue Jun 21 16:27:29 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:38.545970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:38.546571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:38.546571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:38.550856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:27:38.557781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b824e-efef-4a08-901a-200aa356e34d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:38.558215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b824e-efef-4a08-901a-200aa356e34d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:38.558417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b824e-efef-4a08-901a-200aa356e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:38.627790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: INFO dbcounter [None req-071b824e-efef-4a08-901a-200aa356e34d None None] Registered counter for database keystone Jun 21 16:27:38.650013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG oslo_db.sqlalchemy.engines [None req-071b824e-efef-4a08-901a-200aa356e34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:27:38.656692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writer thread running {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:27:38.832494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG passlib.handlers.bcrypt [None req-071b824e-efef-4a08-901a-200aa356e34d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80609) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 16:27:38.832826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG passlib.handlers.bcrypt [None req-071b824e-efef-4a08-901a-200aa356e34d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80609) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 16:27:38.887480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-071b824e-efef-4a08-901a-200aa356e34d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:38.889079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-071b824e-efef-4a08-901a-200aa356e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:39.009194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 16:27:39.176856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:39.248266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: INFO dbcounter [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] Registered counter for database keystone Jun 21 16:27:39.267932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG oslo_db.sqlalchemy.engines [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:27:39.274999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writer thread running {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:27:39.401911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c4f8-3510-4123-bd98-779cbc6ef90d None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:39.406266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:39.406933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:39.407226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:39.407510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:39.416746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:39.469645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 16:27:39.469921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46046bc3-6ab2-42ae-80f7-de638433ea59 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:39.480628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Jun 21 16:27:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:27:39.486628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b824e-efef-4a08-901a-200aa356e34d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:39.501136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b824e-efef-4a08-901a-200aa356e34d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:39.505648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:39.506751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:39.507047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:39.507330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] PATH_INFO: `/v3/projects/5b5dc23437bc45dfae144cb9e387649c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:39.512179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b5dc23437bc45dfae144cb9e387649c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:39.563656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING keystone.common.rbac_enforcer.enforcer [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 16:27:39.564203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a263be-ef60-454a-8b8b-ba8742d2a782 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:39.568635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Tue Jun 21 16:27:39 2022] GET /identity/v3/projects/5b5dc23437bc45dfae144cb9e387649c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:41.618751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f142bcb-9c0e-48ae-ad75-ffb92a9fee8c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:41.619273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f142bcb-9c0e-48ae-ad75-ffb92a9fee8c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:41.619356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f142bcb-9c0e-48ae-ad75-ffb92a9fee8c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:41.623497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:41.628920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:41.629361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:41.629543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:41.648093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:41.650427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:41.658279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 16:27:41.681495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f142bcb-9c0e-48ae-ad75-ffb92a9fee8c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:41.693532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f142bcb-9c0e-48ae-ad75-ffb92a9fee8c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:41.698367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920bb7-de29-47ca-9ac6-fb7425d4c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:41.699002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920bb7-de29-47ca-9ac6-fb7425d4c92f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:41.699296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920bb7-de29-47ca-9ac6-fb7425d4c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:41.699580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920bb7-de29-47ca-9ac6-fb7425d4c92f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:41.707287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3920bb7-de29-47ca-9ac6-fb7425d4c92f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:41.709049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3920bb7-de29-47ca-9ac6-fb7425d4c92f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:41.718512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Jun 21 16:27:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:27:41.724228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:41.733333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072eaf-092a-4725-8581-e1d6df17a9b8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:41.737721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db456a-5866-4942-ac51-d7db3439fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:41.738576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db456a-5866-4942-ac51-d7db3439fe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:41.738867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db456a-5866-4942-ac51-d7db3439fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:41.739155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db456a-5866-4942-ac51-d7db3439fe2f admin admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:41.740543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db456a-5866-4942-ac51-d7db3439fe2f admin admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:41.742489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db456a-5866-4942-ac51-d7db3439fe2f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:41.744118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Tue Jun 21 16:27:41 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:43.870445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf718a3e-bd14-4282-881b-074047af04e0 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:43.870973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf718a3e-bd14-4282-881b-074047af04e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:43.871047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf718a3e-bd14-4282-881b-074047af04e0 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:43.872383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:43.872582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9b26-1329-4484-beb9-4ea11c3fae0f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:43.873001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9b26-1329-4484-beb9-4ea11c3fae0f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:43.873152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9b26-1329-4484-beb9-4ea11c3fae0f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:43.874568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:43.877266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:43.877580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:43.877864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:43.879389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:43.879689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:43.879979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:43.897156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:43.898449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:43.919936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG passlib.handlers.bcrypt [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80610) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 16:27:43.920448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG passlib.handlers.bcrypt [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80610) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 16:27:43.972705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:43.974464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:43.981536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 7/12] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:27:44.003824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.027303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.076825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 6/13] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:27:44.100791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.110809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72f33d-c778-47e9-b536-d16a779fdfc6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.146001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.146589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.146881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.147163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.202969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5a318-cd42-40da-b1ee-19281696b342 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.205359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.214922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.216478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.240351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.246223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.247268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.247558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.247838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.259943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:44.273091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:44.280907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:27:44.281715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.321231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:27:44.326884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.381828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c2feb-7f95-4713-b607-b430f800025c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.419111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.420055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.420348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.420632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.421425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:44.421745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.423271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.426791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a8a9-9d57-4ab2-9dd4-3919c7e9b4e2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.436039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 8/16] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:44.441656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.450162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.462358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.463156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.463440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.468734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.472525 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.474914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.476552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:27:44.498991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:44.500098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:44.501166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:27:44.501166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:27:44.501166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:27:44.501166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:27:44.501166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:44.506837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.549234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d069a-7059-4a30-b932-1d14191a585e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.582777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.583650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.583942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.584224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.586410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.587905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.589642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:44.594962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.610230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3247-1867-4027-a2f3-ceca8773301d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.645637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.646580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.647069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.647569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.649195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:44.649636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.651188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.670059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:44.697190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.704513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c47b-3062-4402-9084-d349e0d64f3f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.744600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8a3c5-31fd-406f-86ab-7526b14c3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.746255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8a3c5-31fd-406f-86ab-7526b14c3260 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.746255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8a3c5-31fd-406f-86ab-7526b14c3260 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.746255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8a3c5-31fd-406f-86ab-7526b14c3260 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.747337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8a3c5-31fd-406f-86ab-7526b14c3260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.748885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8a3c5-31fd-406f-86ab-7526b14c3260 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.750734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:44.756817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:44.796227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:44.871508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c5dca-97f9-4dbb-940d-78f7e90f01da None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:44.909328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:44.910060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:44.910305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:44.910592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:44.911438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.domain.id=default, user.id=8935c834d03f4a008037c7655781e212) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:44.911758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:44.913314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72391a-00e5-426b-b845-95285ef9c71e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:44.920949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Tue Jun 21 16:27:44 2022] GET /identity/v3/role_assignments?user.id=8935c834d03f4a008037c7655781e212&scope.domain.id=default&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:47.191615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242218b1-9807-4526-ad12-7effc59455c9 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.192573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242218b1-9807-4526-ad12-7effc59455c9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.193057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242218b1-9807-4526-ad12-7effc59455c9 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.194663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:47.200989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.201488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.201672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.225894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:47.227699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:47.258555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab55f-6e89-407b-b18d-aecef3a53425 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.259175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab55f-6e89-407b-b18d-aecef3a53425 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.259650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab55f-6e89-407b-b18d-aecef3a53425 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.261226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 12/23] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:27:47.267633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015c37-2459-464e-8529-e393c83f6975 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.279465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015c37-2459-464e-8529-e393c83f6975 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.280032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015c37-2459-464e-8529-e393c83f6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.322408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-58015c37-2459-464e-8529-e393c83f6975 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:47.323919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-58015c37-2459-464e-8529-e393c83f6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:47.332716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:47.382842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:47.425668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:47.547775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 13/25] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:47.548153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fc20a-8054-43f2-b10c-119b4ac2abb9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:47.587418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58015c37-2459-464e-8529-e393c83f6975 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:47.601044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:47.602616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.602911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.603198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.625797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:47.627357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ab3a4213-e5f9-4e0c-ba3d-f56a17ce94ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:27:47.651730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:47.652759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:47.653831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:27:47.653831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:27:47.653831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:27:47.653831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:27:47.666701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 13/26] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:47.670170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e597b-a371-4c65-bc5f-f4f085722442 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.671751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e597b-a371-4c65-bc5f-f4f085722442 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.672231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e597b-a371-4c65-bc5f-f4f085722442 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.674453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:47.679745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e597b-a371-4c65-bc5f-f4f085722442 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:47.769726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:47.786448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58015c37-2459-464e-8529-e393c83f6975 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:47.825703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:47.858692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3888d0-0bb5-44ac-9614-5cae488dd422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:47.859374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3888d0-0bb5-44ac-9614-5cae488dd422 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.859666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3888d0-0bb5-44ac-9614-5cae488dd422 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.859956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3888d0-0bb5-44ac-9614-5cae488dd422 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.860717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3888d0-0bb5-44ac-9614-5cae488dd422 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:47.862149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3888d0-0bb5-44ac-9614-5cae488dd422 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:47.865953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e597b-a371-4c65-bc5f-f4f085722442 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:47.906186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:47.906862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.907155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.907555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.908180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:47.908493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:47.909947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edc89d-23e4-483c-ad06-4784d84f8065 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:47.922981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 15/28] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:47.924254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:47.924588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:47.924833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:47.942451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:47.943663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:48.021462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 16/29] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:48.022784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:48.117895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:48.127378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 14/30] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Jun 21 16:27:47 2022] POST /identity/v3/roles => generated 219 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:27:48.130078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d101-ddda-494e-b5c9-b210f38b4729 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.130715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d101-ddda-494e-b5c9-b210f38b4729 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.131581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d101-ddda-494e-b5c9-b210f38b4729 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.134261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 15/31] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:48.135789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d101-ddda-494e-b5c9-b210f38b4729 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:48.153248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb341a-ed0c-40aa-9f62-8284f711cd76 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:48.193924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:48.194760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.196089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.196450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.197249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:48.198976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:48.277304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d101-ddda-494e-b5c9-b210f38b4729 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:48.316300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff66f6-ac03-42ba-93bc-3c2b78d97898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:48.317179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff66f6-ac03-42ba-93bc-3c2b78d97898 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.317508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff66f6-ac03-42ba-93bc-3c2b78d97898 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.317795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff66f6-ac03-42ba-93bc-3c2b78d97898 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.338969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff66f6-ac03-42ba-93bc-3c2b78d97898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-34ff66f6-ac03-42ba-93bc-3c2b78d97898 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:48.347880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:48.348742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:48.349554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:27:48.352507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 16/32] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:48.354057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.354555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.355098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.376170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:48.377215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:48.387215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:48.462816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 17/33] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:48.464123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:48.482726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 17/34] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:27:48 2022] POST /identity/v3/projects => generated 301 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:27:48.497551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:48.591955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851025b-58e9-486f-ab4c-985df394d2ab None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:48.637659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:48.638737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.639231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.639899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.641540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:48.642266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:48.644409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315499-ad55-4883-ba09-76bff7419ef0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:48.668270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 18/35] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:48.668270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49956a7d-9f1e-4c2e-8e77-ebb85020359c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.668270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49956a7d-9f1e-4c2e-8e77-ebb85020359c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.668270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49956a7d-9f1e-4c2e-8e77-ebb85020359c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.669311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:48.674697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49956a7d-9f1e-4c2e-8e77-ebb85020359c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:48.680831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:48.696041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1306f-a419-4c02-80bf-7823e1ec2039 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:48.720848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:48.735042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03868-cc81-45b3-92a3-3b20c1dfc729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:48.735849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03868-cc81-45b3-92a3-3b20c1dfc729 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.736223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03868-cc81-45b3-92a3-3b20c1dfc729 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.736557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03868-cc81-45b3-92a3-3b20c1dfc729 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.737522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03868-cc81-45b3-92a3-3b20c1dfc729 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:48.739205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03868-cc81-45b3-92a3-3b20c1dfc729 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:48.790570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49956a7d-9f1e-4c2e-8e77-ebb85020359c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:48.825724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f3b3-ea6a-4995-97ac-a48a1dbb9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:48.826447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f3b3-ea6a-4995-97ac-a48a1dbb9d0c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.826736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f3b3-ea6a-4995-97ac-a48a1dbb9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.827022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f3b3-ea6a-4995-97ac-a48a1dbb9d0c None admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.828336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265f3b3-ea6a-4995-97ac-a48a1dbb9d0c None admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:48.829811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265f3b3-ea6a-4995-97ac-a48a1dbb9d0c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:48.831467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 20/37] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:27:48 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:48.832734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67299-53ed-449a-b776-8adfd9594e17 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.833078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67299-53ed-449a-b776-8adfd9594e17 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.833390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67299-53ed-449a-b776-8adfd9594e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.841101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 18/38] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Jun 21 16:27:48 2022] POST /identity/v3/roles => generated 225 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:27:48.842615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964fcb9-290d-4a98-ad7c-1f338dc52611 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.842917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964fcb9-290d-4a98-ad7c-1f338dc52611 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.843208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964fcb9-290d-4a98-ad7c-1f338dc52611 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.844742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 19/39] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:48.849994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964fcb9-290d-4a98-ad7c-1f338dc52611 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:48.852550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-eab67299-53ed-449a-b776-8adfd9594e17 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:48.853830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-eab67299-53ed-449a-b776-8adfd9594e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:48.936024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 21/40] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:48.936024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:48.936024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:48.936024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:48.946029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:48.962118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:48.963497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:48.982826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964fcb9-290d-4a98-ad7c-1f338dc52611 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:49.029345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:49.030317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:49.030677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:49.030970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:49.032262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:49.033801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:49.035782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 20/41] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:49.036611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:49.051522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 22/42] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:49.052421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:49.092944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:49.162168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799e78-741b-4c7c-9c71-4601fc8bef18 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:49.194250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:49.199671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:49.205171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:49.205171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:49.205171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] PATH_INFO: `/v3/domains/default/users/8935c834d03f4a008037c7655781e212/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:49.205171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8935c834d03f4a008037c7655781e212, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:49.205171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:49.250671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b9fad-000b-42c2-b75b-35bb34ac8010 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:49.286050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a61b3-49ad-40c1-aa68-a171d002f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:49.286737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a61b3-49ad-40c1-aa68-a171d002f7d5 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:49.287025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a61b3-49ad-40c1-aa68-a171d002f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:49.287338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a61b3-49ad-40c1-aa68-a171d002f7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:49.288094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a61b3-49ad-40c1-aa68-a171d002f7d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:49.290093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a61b3-49ad-40c1-aa68-a171d002f7d5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:49.313872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 23/43] 10.222.0.70 () {58 vars in 1361 bytes} [Tue Jun 21 16:27:49 2022] PUT /identity/v3/domains/default/users/8935c834d03f4a008037c7655781e212/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:27:49.314713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:49.428955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca1f49-9e03-42f9-9621-5413db9ffb20 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:49.468690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:49.469455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:49.469771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:49.470126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:49.471308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:49.473150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:49.474889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 24/44] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:49.481184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:49.498409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 21/45] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Jun 21 16:27:49 2022] POST /identity/v3/roles => generated 223 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:27:49.549205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:49.598988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6874c-4385-4d1e-85e7-ee36c8f29a4c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:49.638797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42acc3-0b67-456b-8d6e-3e9f99fd8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:49.639961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42acc3-0b67-456b-8d6e-3e9f99fd8102 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:49.640285 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42acc3-0b67-456b-8d6e-3e9f99fd8102 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:49.640602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42acc3-0b67-456b-8d6e-3e9f99fd8102 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:49.641371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42acc3-0b67-456b-8d6e-3e9f99fd8102 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:49.642937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42acc3-0b67-456b-8d6e-3e9f99fd8102 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:49.756250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 25/46] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:27:49 2022] POST /identity/v3/projects => generated 312 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:27:51.344481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ef1c-dc93-4e40-acf0-89b5b6de9393 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:51.344989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ef1c-dc93-4e40-acf0-89b5b6de9393 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:51.345069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ef1c-dc93-4e40-acf0-89b5b6de9393 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:51.346664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 22/47] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:51.352118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:51.352548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:51.352699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:51.372020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:51.373223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:51.550063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 26/48] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:51.574363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ef1c-dc93-4e40-acf0-89b5b6de9393 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:51.676685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ef1c-dc93-4e40-acf0-89b5b6de9393 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:51.688182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:51.710937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e2385-ee48-45f7-bdfb-a9a1124b7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:51.711788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2385-ee48-45f7-bdfb-a9a1124b7aba None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:51.712080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2385-ee48-45f7-bdfb-a9a1124b7aba None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:51.712365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2385-ee48-45f7-bdfb-a9a1124b7aba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:51.723859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e2385-ee48-45f7-bdfb-a9a1124b7aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d71e2385-ee48-45f7-bdfb-a9a1124b7aba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:51.734203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:51.736195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:27:51.738097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 23/49] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:51.741376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:51.785688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:51.836083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef565-6d83-43ae-8982-576925260802 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:51.836301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef565-6d83-43ae-8982-576925260802 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:51.836640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef565-6d83-43ae-8982-576925260802 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:51.838170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 24/50] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:27:51.841466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109de6b4-dc60-47b4-bb34-ca11b5d7f05d None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:51.843254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:51.843577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:51.843864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:51.861623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:51.863146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:51.878067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:51.878739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:51.879033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:51.879315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:51.880077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:51.880392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:51.881830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:51.891367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 27/51] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:51.896606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:51.933130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 25/52] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:27:51.956631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:51.998060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe321a4-837c-4284-a0e2-48abcc1f8ff5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:52.000313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:52.032453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:52.033356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:52.033643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:52.033928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:52.035127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:52.036599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:52.038455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 28/53] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:27:51 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:52.043772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:52.052446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:52.057129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4211-8df8-4b88-a11a-0375cfa5009b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:52.092643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:52.093397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:52.093685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:52.093972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:52.095148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:52.096621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:52.098739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 26/54] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:52.104638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:52.143305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ea410-cfab-41d9-85cd-ddc44af8f879 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:52.177429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:52.178222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:52.178521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:52.178805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:52.180670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:52.182173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:52.183842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 29/55] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:52.189663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:52.203393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255d4e8-598d-4d38-a45a-bf93f3fda80e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:52.232080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:52.238572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327b7a5-e88c-4547-9236-b501951b5268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:52.239238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327b7a5-e88c-4547-9236-b501951b5268 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:52.245090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327b7a5-e88c-4547-9236-b501951b5268 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:52.245090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327b7a5-e88c-4547-9236-b501951b5268 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:52.245090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327b7a5-e88c-4547-9236-b501951b5268 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:52.245090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327b7a5-e88c-4547-9236-b501951b5268 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:52.291130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511a89-be93-46ba-bdb7-2742c0545605 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:52.324474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:52.325125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:52.325454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:52.325744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:52.326611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.domain.id=default, user.id=8935c834d03f4a008037c7655781e212) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:52.327023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:52.328497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080536e3-80f9-420b-8bed-214baacce11b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:52.337251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 30/56] 10.222.0.70 () {56 vars in 1322 bytes} [Tue Jun 21 16:27:52 2022] GET /identity/v3/role_assignments?user.id=8935c834d03f4a008037c7655781e212&scope.domain.id=default&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:27:52.344836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 27/57] 10.222.0.70 () {60 vars in 1140 bytes} [Tue Jun 21 16:27:52 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:27:54.426600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76dbd4-ec8e-4e1c-b6e0-f414753e6042 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:54.427113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76dbd4-ec8e-4e1c-b6e0-f414753e6042 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:54.427224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76dbd4-ec8e-4e1c-b6e0-f414753e6042 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:54.428590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 31/58] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:54.433828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:54.434301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:54.434412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:54.451327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:54.452532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:54.466991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:54.519070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 28/59] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:27:54.544448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76dbd4-ec8e-4e1c-b6e0-f414753e6042 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:54.647445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76dbd4-ec8e-4e1c-b6e0-f414753e6042 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:54.650386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:54.680539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13856-4a19-4c05-8a63-2b8051d3e909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:54.681361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13856-4a19-4c05-8a63-2b8051d3e909 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:54.681653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13856-4a19-4c05-8a63-2b8051d3e909 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:54.681937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13856-4a19-4c05-8a63-2b8051d3e909 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:54.683111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13856-4a19-4c05-8a63-2b8051d3e909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:54.684566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13856-4a19-4c05-8a63-2b8051d3e909 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:54.686245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 32/60] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:54.691767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:54.792376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dda0-a3dd-4018-be64-c9c69e96a9c0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:54.826211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3e92-3e57-4446-a1a9-fdc856d146ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:54.826883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3e92-3e57-4446-a1a9-fdc856d146ad None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:54.827173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3e92-3e57-4446-a1a9-fdc856d146ad None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:54.827457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3e92-3e57-4446-a1a9-fdc856d146ad None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:54.828176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3e92-3e57-4446-a1a9-fdc856d146ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:54.829660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3e92-3e57-4446-a1a9-fdc856d146ad None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:54.936575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 29/61] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:27:54 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:27:58.126382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae480-2bc5-47d4-b0e5-3eff880512e3 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.127240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae480-2bc5-47d4-b0e5-3eff880512e3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.127760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae480-2bc5-47d4-b0e5-3eff880512e3 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.129322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 33/62] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:58.135930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcee520-7fba-4e97-8215-6f65cfe56f72 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.136408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcee520-7fba-4e97-8215-6f65cfe56f72 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.136694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcee520-7fba-4e97-8215-6f65cfe56f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.153188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:58.161884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-cfcee520-7fba-4e97-8215-6f65cfe56f72 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:58.164151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cfcee520-7fba-4e97-8215-6f65cfe56f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:58.255651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 30/63] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:58.301470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae480-2bc5-47d4-b0e5-3eff880512e3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:58.302243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cac37-0287-44f8-8e52-68803573c876 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.302511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cac37-0287-44f8-8e52-68803573c876 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.302799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cac37-0287-44f8-8e52-68803573c876 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.304489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 31/64] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:27:58.321427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a36ee-7624-4b6f-8290-43724adc872e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.322039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a36ee-7624-4b6f-8290-43724adc872e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.322510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a36ee-7624-4b6f-8290-43724adc872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.356327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f66a36ee-7624-4b6f-8290-43724adc872e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:58.359252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f66a36ee-7624-4b6f-8290-43724adc872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:58.493487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae480-2bc5-47d4-b0e5-3eff880512e3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:58.498857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 32/65] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:27:58.525167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff0e62-bf3c-485e-b7f6-0abe33cbf427 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.525818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff0e62-bf3c-485e-b7f6-0abe33cbf427 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.526293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff0e62-bf3c-485e-b7f6-0abe33cbf427 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.528012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 33/66] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:58.532968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378b71d-d4df-40f6-964d-2d4069cca3c3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.533548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378b71d-d4df-40f6-964d-2d4069cca3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.534042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378b71d-d4df-40f6-964d-2d4069cca3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.557078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2378b71d-d4df-40f6-964d-2d4069cca3c3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:58.558639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2378b71d-d4df-40f6-964d-2d4069cca3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:58.564467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:58.565631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.566112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.566583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.578635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:58.587755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:58.588583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:27:58.589354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:27:58.591706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 34/67] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:58.592880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:58.627711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:58.628599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:58.644488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 34/68] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:27:58.644488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccac17-7c87-45a9-9bb6-5d967afd9568 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.644488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccac17-7c87-45a9-9bb6-5d967afd9568 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.644488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccac17-7c87-45a9-9bb6-5d967afd9568 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.644488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 35/69] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:58.645218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccac17-7c87-45a9-9bb6-5d967afd9568 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:58.702839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ea6b6-91e0-40e4-9152-68edf90abadc None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:58.743272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b427-78ec-4872-ae40-ea86504d508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:58.744131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b427-78ec-4872-ae40-ea86504d508a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.744369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b427-78ec-4872-ae40-ea86504d508a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.744650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b427-78ec-4872-ae40-ea86504d508a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.754939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b427-78ec-4872-ae40-ea86504d508a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-7243b427-78ec-4872-ae40-ea86504d508a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:58.763489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:58.764370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:27:58.765128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 35/70] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:58.766223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663a4f2-6bcc-455c-9ef0-fd4e960d9934 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.766518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663a4f2-6bcc-455c-9ef0-fd4e960d9934 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.766799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663a4f2-6bcc-455c-9ef0-fd4e960d9934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.772163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccac17-7c87-45a9-9bb6-5d967afd9568 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:58.783482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c663a4f2-6bcc-455c-9ef0-fd4e960d9934 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:58.784667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c663a4f2-6bcc-455c-9ef0-fd4e960d9934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:58.806433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:58.807109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.807400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.807692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.808446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:58.808765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:58.810221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:58.822712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:58.824659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:58.852270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 36/72] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:58.862796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187645e-1393-401a-a7d4-e0e70c8b378b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.862796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187645e-1393-401a-a7d4-e0e70c8b378b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.862796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187645e-1393-401a-a7d4-e0e70c8b378b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.862796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 37/73] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:27:58.862796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187645e-1393-401a-a7d4-e0e70c8b378b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:58.882582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:58.891978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:58.935110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52bee-bc9a-49ac-8b1d-6e3751ad30c6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:58.960456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187645e-1393-401a-a7d4-e0e70c8b378b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:58.968323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:58.970803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:58.970803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:58.970803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:58.980740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:58.989029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:58.989913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:27:58.990659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:27:58.993151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 37/74] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:58.994113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.007900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.007900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.007900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.007900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.008447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:59.008447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.008447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03c1b-8969-4cdf-9b0c-e41c8fbe0670 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.010921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 38/75] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.016581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.016881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.017247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.033669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:27:59.034887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:27:59.097596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1687a-7df6-48ce-8bd4-b05805259a35 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.104410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 39/76] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:27:59.105254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.121106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.127034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.144361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.145248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.145576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.145863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.159945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.161516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.163791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 38/77] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:27:58 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.164581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.206890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e999a6-2ca5-4470-bd6d-aa67a71a607a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.241952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.242764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.243055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.243335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.253840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:27:59.262303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:27:59.263202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:27:59.264000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 40/78] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:27:59.265523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.267222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7929c-a2f9-400f-bf02-be94882c5199 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.304367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.305062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.305392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.305685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.306441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:59.306759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.308214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.321130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 39/79] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.321130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.349083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.360124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.373654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fc160-a74c-45a3-a01c-9c2b4c414675 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.407492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.408371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.408663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.408945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.410178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.411636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.414500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 41/80] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.415275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.419700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56c3d9-3528-4251-be0b-6719e3d4c9ca None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.453947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.454740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.455027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.455311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.456483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.457989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.460157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 40/81] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.460157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.514458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa7a4-9922-4e7d-bb2e-2eda9ea9e5ba None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.556779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.557470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.557761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.558042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.567313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5908-f1ab-45ba-8fb2-f4c821b10f81 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.570419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.574770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.603352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.604084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.604374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.604661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.605450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:27:59.605776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.607201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.615733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 41/82] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.620363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.636640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.638162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.719269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9508-284e-488a-a208-bf0621abba6e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.736272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 42/83] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:27:59.737379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.758308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.759435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.759726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.760011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.761208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.762711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.764375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 42/84] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:27:59.765166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:27:59.784318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.799167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:27:59.840879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202b452-fbc4-441f-9cde-e704d497f54e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.866822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a297e9-3294-4c9c-a7e4-7eb717b93822 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:27:59.873211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.873892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.874184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.874472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.901652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:27:59.902416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:27:59.902647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:27:59.902922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:27:59.903641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.905099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.940871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:27:59.942423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:27:59.983523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.011118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 43/85] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:27:59 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:00.011977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.048342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 43/86] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:00.049235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.153698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.164998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fb899-268e-45e6-825e-b0768ddb0640 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.165160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1df3-0a52-44da-a927-ff9ae306e2ac None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.203828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.204683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.205209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.205338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.206484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:00.207918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:00.213324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 44/87] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:00.213324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.214639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.216561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.217081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.217571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.219230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:00.220729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:00.222854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 44/88] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:00.223553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.230702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.373399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63548194-d5d8-4ed2-806c-0f0c82f7f05b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.373580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476fea0-a0fb-4318-8b19-19186c0857ce None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.410041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.410241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.411139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.411243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.411529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.411869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.411972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.412408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.414313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:00.415790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:00.418566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 45/89] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:00.419293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.452509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.504568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:00.506956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:00.519194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.543278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379777d-271b-4ba8-8d6e-10feeaa68198 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.603735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.604408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.604700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.604987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.606489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=df0ccfdb6af840879aee5a3f4397093a) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:00.606820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:00.608319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:00.615886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 46/90] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/role_assignments?user.id=df0ccfdb6af840879aee5a3f4397093a&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=e446eb256dc14055b69a04a154fdc373 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:00.616901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.628463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 45/91] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:00.629324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:00.799217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.813991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a381e-2e22-4bf3-96c2-9b681d141f30 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.815050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99ae60-3b54-4c4c-ab7b-2929f0bac0aa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:00.834617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:00.879444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.880810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.881838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.883083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.884603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=8935c834d03f4a008037c7655781e212) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:00.885390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:00.885878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:00.886677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:00.888306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:00.888766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:00.889206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:00.904556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 46/92] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/role_assignments?user.id=8935c834d03f4a008037c7655781e212&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:00.905646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:01.007524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:01.009330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:01.110215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:01.121946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 47/93] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:01.130475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:01.263558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedfec4-034a-4ee3-a39c-ffc15630a44e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:01.281111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a647fc4-95f7-41ad-845d-3683d2c1722f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:01.330278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:01.330919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:01.331214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:01.331503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:01.334038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:01.336072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:01.337896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 48/94] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:01 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:01.345550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:01.346010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:01.347691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:01.348495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:01.350980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] PATH_INFO: `/v3/projects/cb146ec0941c40cb8480da868c21576c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:01.352417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] RBAC: Authorizing `identity:get_project(project_id=cb146ec0941c40cb8480da868c21576c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:01.355135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:01.361469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 47/95] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:00 2022] GET /identity/v3/projects/cb146ec0941c40cb8480da868c21576c => generated 312 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:01.368761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:01.453762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:01.493145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d397692-7913-4c13-a8cb-4929b1698c2e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:01.542783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:01.543769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:01.544207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:01.544643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:01.545813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=cb146ec0941c40cb8480da868c21576c, user.id=df0ccfdb6af840879aee5a3f4397093a) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:01.546299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:01.547901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0712d7-ebca-4ee8-bcc6-8e002926c8f1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:01.560038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 48/96] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:01 2022] GET /identity/v3/role_assignments?user.id=df0ccfdb6af840879aee5a3f4397093a&scope.project.id=cb146ec0941c40cb8480da868c21576c&role.id=e446eb256dc14055b69a04a154fdc373 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:01.568234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:01.646279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1213f-8a3b-4b80-bc98-1a80b9a92344 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:01.703159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:01.703913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:01.704141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:01.704423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:01.705289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] RBAC: Adding query filter params (role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=df0ccfdb6af840879aee5a3f4397093a) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:01.705608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:01.707065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3736c-3354-4ee1-b7b4-e63d3c393095 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:01.714302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 49/97] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:01 2022] GET /identity/v3/role_assignments?user.id=df0ccfdb6af840879aee5a3f4397093a&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=3ad4a86440e943caac11daabeeb44957 => generated 259 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:02.498001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b40cf-3985-47a3-a3fa-edc861b7fcdd None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:02.499041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b40cf-3985-47a3-a3fa-edc861b7fcdd None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:02.499543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b40cf-3985-47a3-a3fa-edc861b7fcdd None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:02.501163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 49/98] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:02.506611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:02.507618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:02.508121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:02.526080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:02.527656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:02.613128 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 50/99] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:02.644481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b40cf-3985-47a3-a3fa-edc861b7fcdd None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:02.774128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b40cf-3985-47a3-a3fa-edc861b7fcdd None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:02.785509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:02.818380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55cdf7-89d7-47c8-b368-c45d8bfd9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:02.820071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55cdf7-89d7-47c8-b368-c45d8bfd9c9a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:02.820753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55cdf7-89d7-47c8-b368-c45d8bfd9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:02.825655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55cdf7-89d7-47c8-b368-c45d8bfd9c9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:02.837835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55cdf7-89d7-47c8-b368-c45d8bfd9c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-4c55cdf7-89d7-47c8-b368-c45d8bfd9c9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:02.845958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:02.847059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:02.847815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:02.850495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 50/100] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:02.856401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:02.914624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:02.969030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27b3d0-ba61-412f-96a4-cb34a55a86ae None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:03.008796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6d76-bb77-4098-a900-e7fd95bc1cc4 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.009127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6d76-bb77-4098-a900-e7fd95bc1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.009394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6d76-bb77-4098-a900-e7fd95bc1cc4 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.011104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 51/101] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:03.016680 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.016980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.017269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.033664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:03.034365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.034653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.034938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.035763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:03.036023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:03.037503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:03.048196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:03.048196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:03.054184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 51/102] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:03.059908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:03.179210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 52/103] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:03.248399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449fd5-7959-4dd4-a7bf-0b9a864e7087 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:03.270054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:03.278487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:03.304873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:03.307786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.307786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.307786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] PATH_INFO: `/v3/users/a83749f1e9174968a577f6fa75ab1d46` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.332779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] RBAC: Authorizing `identity:get_user(user_id=a83749f1e9174968a577f6fa75ab1d46)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:03.334719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:03.337179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 52/104] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:03 2022] GET /identity/v3/users/a83749f1e9174968a577f6fa75ab1d46 => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:03.342965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:03.492469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:03.504418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef4ced-6098-4f5a-8da2-9347057f8086 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:03.550823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a119-7326-435a-9c26-6aad3f793647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:03.551641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a119-7326-435a-9c26-6aad3f793647 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.551968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a119-7326-435a-9c26-6aad3f793647 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.552257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a119-7326-435a-9c26-6aad3f793647 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.554041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a119-7326-435a-9c26-6aad3f793647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:03.556245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a119-7326-435a-9c26-6aad3f793647 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:03.558104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 53/105] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:03.559425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c015d-70c3-4103-bb9f-5e70d209d038 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.559884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c015d-70c3-4103-bb9f-5e70d209d038 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.560325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c015d-70c3-4103-bb9f-5e70d209d038 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.561775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 54/106] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:03.566166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c015d-70c3-4103-bb9f-5e70d209d038 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:03.585752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44518fcc-a92f-4e1a-b02b-52eed9e8385d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:03.641783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8aed26-75ab-4aef-874c-f074627b4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:03.642829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aed26-75ab-4aef-874c-f074627b4266 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.643330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aed26-75ab-4aef-874c-f074627b4266 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.643839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aed26-75ab-4aef-874c-f074627b4266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.716891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:03.761895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8aed26-75ab-4aef-874c-f074627b4266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:03.763829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8aed26-75ab-4aef-874c-f074627b4266 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:03.792696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c015d-70c3-4103-bb9f-5e70d209d038 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:03.834573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:03.835148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.835469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.835762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.836485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:03.837977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:03.902792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 53/107] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:03.904298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:03.904599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:03.904888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:03.922561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:03.923778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:03.936697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 55/108] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:28:03 2022] POST /identity/v3/projects => generated 302 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:03.937702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:03.979438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:04.079006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 54/109] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:04.116369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9dfb-5b2b-4000-964d-ed66526ed226 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:04.120842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:04.124791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:04.157306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:04.161300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.161300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.161300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.163736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:04.167701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:04.170901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 56/110] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:03 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:04.176765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:04.342666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefea42-d48f-4bda-8334-778cd4d31c47 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:04.367329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:04.398550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01dbd-f82c-4d3f-93d3-bf1c11796074 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:04.422015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:04.424599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.425102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.425600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.446925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:04.455908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:04.456771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:04.457567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:04.467890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 55/111] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:04.471237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:04.472433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.472940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.474068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:04.474562 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.476077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] RBAC: Adding query filter params (role.id=4289c849c84d496592da62bc05d78f8d, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=a83749f1e9174968a577f6fa75ab1d46) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:04.476969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:04.481436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e91638-1c9a-400c-928d-7d8dd5c8647f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:04.494998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 57/112] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:04 2022] GET /identity/v3/role_assignments?user.id=a83749f1e9174968a577f6fa75ab1d46&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=4289c849c84d496592da62bc05d78f8d => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:04.550818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde454f-2564-4716-86bb-432acc2fce6e None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.551903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde454f-2564-4716-86bb-432acc2fce6e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.552374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde454f-2564-4716-86bb-432acc2fce6e None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.554922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 58/113] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:04.562262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e53f-bd6a-47e7-a7de-c3518e9b7c4d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.562903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e53f-bd6a-47e7-a7de-c3518e9b7c4d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.563385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e53f-bd6a-47e7-a7de-c3518e9b7c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.567376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:04.583467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f558e53f-bd6a-47e7-a7de-c3518e9b7c4d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:04.586042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f558e53f-bd6a-47e7-a7de-c3518e9b7c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:04.608041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382e70-080e-466e-b6c6-ca5c0063fa11 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:04.645771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:04.646393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.647390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.647701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.648587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:04.648918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:04.650414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c736-e2d7-4d8e-8233-c914be0721af None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:04.660545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 56/114] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:04.661725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578b895-06bb-483d-b8e9-110d653fa35d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.662016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578b895-06bb-483d-b8e9-110d653fa35d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.662308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578b895-06bb-483d-b8e9-110d653fa35d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.664382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 57/115] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:04.672628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d866-0efe-4900-8633-6449f23338c3 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.672628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d866-0efe-4900-8633-6449f23338c3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.672628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d866-0efe-4900-8633-6449f23338c3 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.672628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 58/116] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:04.672628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d866-0efe-4900-8633-6449f23338c3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:04.677226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 59/117] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:04.678901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108170-ffb8-4332-8bcb-b81677ae8596 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.679406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108170-ffb8-4332-8bcb-b81677ae8596 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.679869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108170-ffb8-4332-8bcb-b81677ae8596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.697831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-82108170-ffb8-4332-8bcb-b81677ae8596 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:04.699370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-82108170-ffb8-4332-8bcb-b81677ae8596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:04.775909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 60/118] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:04.785299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.785446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d866-0efe-4900-8633-6449f23338c3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:04.786097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.786567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.810287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:04.818706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:04.830000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:04.830144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:04.830224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.830224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.830224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.830422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:04.830497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:04.830497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:04.830497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 59/119] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:04 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:04.830497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:04.902237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 61/120] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:04.910554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:04.934220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cec4-d36b-448c-a935-04154c60d53e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:04.978949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:04.980109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:04.980627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:04.981216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:04.993626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:05.003009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:05.003874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:05.004651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:05.007787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 60/121] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:05.008938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.036165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530ece-9ab7-4000-bfd7-12b335179b12 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.072999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.073839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.074161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.074415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.081644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.082375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.085503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:05.094057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:05.101563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 62/122] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:05.102464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.145249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac99fc-7d14-4c64-bf7c-3d54674931b0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.185416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.186557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.187053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.187588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.189084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.190866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.193011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 61/123] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.194375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.204943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4a30f-228e-4bfc-9d4e-c75ef470e20c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.240197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.241926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.241926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.242243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.252871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:05.271097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:05.272636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:05.273586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 63/124] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:05.274321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.319737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856080f-46e6-4685-adfe-3cc75e3d6a5a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.342143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.344586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.357568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.358566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.359079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.359561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.360514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:05.361027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.362700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.372474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 62/125] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.373524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.378878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb89571-1e0d-4310-b714-b3bd0294a217 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.415539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.416222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.416515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.417148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.417596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:05.417916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.419378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.427820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 64/126] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.428792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.482881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e7161-bd02-433a-a8dd-5513f01cbc56 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.519929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.521220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.522269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.522772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac/users/df0ccfdb6af840879aee5a3f4397093a/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.525093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2925804921b45939d514246d9ae2dac, user_id=df0ccfdb6af840879aee5a3f4397093a, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.526860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.531871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dec57-6ba3-4f2d-827d-5b28b3bcc8f1 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.553350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.567698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.568370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.568807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.569176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.570080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:05.570391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.571817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.585471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 65/127] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.585471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.633995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 63/128] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:05 2022] PUT /identity/v3/projects/f2925804921b45939d514246d9ae2dac/users/df0ccfdb6af840879aee5a3f4397093a/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:05.635478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.704377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.739388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2674471-f2f8-4ddf-a6e1-2ad4f6039405 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.775298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74cc65-73dd-4757-9bb6-791a66c7959a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.814832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.816070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.816567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.817044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.819023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.819691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.820737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.821030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.821325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.821425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.822577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.824821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.825062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 64/129] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.825855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 66/130] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.827235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.831317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:05.929934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.939032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b6744-890b-4edb-a3e2-2844cb02056d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.954960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:05.977858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:05.981001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:05.981001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:05.981001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:05.981311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:05.983005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:05.984346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d7c9-8d48-43b8-9cd3-286e7fb310bf None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:05.985355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 65/131] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:05.989940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:06.037166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:06.038162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.038637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.038937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.044810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:06.046318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:06.048091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 67/132] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:06.048951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:06.171988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c825-8fe3-4622-abcc-d471d09907f2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:06.176801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3861a-ee10-43a5-b9e3-11450969cba3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:06.191014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:06.210006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:06.211038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.216802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.216802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] PATH_INFO: `/v3/projects/cb146ec0941c40cb8480da868c21576c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.216802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] RBAC: Authorizing `identity:get_project(project_id=cb146ec0941c40cb8480da868c21576c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:06.216802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:06.216802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 68/133] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:06 2022] GET /identity/v3/projects/cb146ec0941c40cb8480da868c21576c => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:06.217952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:06.224656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:06.227467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.228177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.228665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.230466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:06.241446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:06.243723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 66/134] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:05 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:06.244967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:06.324422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:06.378607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3468-694d-457b-9747-c4352df01a45 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:06.405725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca3c5-db8e-4174-923f-4fb448dee2e9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:06.444713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:06.445798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.446088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.446372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac/users/8935c834d03f4a008037c7655781e212/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.450940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2925804921b45939d514246d9ae2dac, user_id=8935c834d03f4a008037c7655781e212, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:06.453651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:06.469752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33593a-c613-45a3-88c2-572cd203bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:06.470709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33593a-c613-45a3-88c2-572cd203bc27 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.471007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33593a-c613-45a3-88c2-572cd203bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.471595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33593a-c613-45a3-88c2-572cd203bc27 None admin] PATH_INFO: `/v3/projects/cb146ec0941c40cb8480da868c21576c/users/df0ccfdb6af840879aee5a3f4397093a/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.473715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33593a-c613-45a3-88c2-572cd203bc27 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb146ec0941c40cb8480da868c21576c, user_id=df0ccfdb6af840879aee5a3f4397093a, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:06.475230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33593a-c613-45a3-88c2-572cd203bc27 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:06.600881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 69/135] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:06 2022] PUT /identity/v3/projects/f2925804921b45939d514246d9ae2dac/users/8935c834d03f4a008037c7655781e212/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:06.602450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:06.655585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 67/136] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:06 2022] PUT /identity/v3/projects/cb146ec0941c40cb8480da868c21576c/users/df0ccfdb6af840879aee5a3f4397093a/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:06.699665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:06.790971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985382b-e81b-46dd-9492-d6fa948d3a19 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:06.833984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9d43e-d9bb-4bc8-9185-057bf2e23937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:06.835459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d43e-d9bb-4bc8-9185-057bf2e23937 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.835956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d43e-d9bb-4bc8-9185-057bf2e23937 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.836440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d43e-d9bb-4bc8-9185-057bf2e23937 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac/users/df0ccfdb6af840879aee5a3f4397093a/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.842117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9d43e-d9bb-4bc8-9185-057bf2e23937 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2925804921b45939d514246d9ae2dac, user_id=df0ccfdb6af840879aee5a3f4397093a, role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:06.843953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9d43e-d9bb-4bc8-9185-057bf2e23937 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:06.848749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ef843-e9e0-4f89-abaf-6a683be0d751 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.849219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ef843-e9e0-4f89-abaf-6a683be0d751 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.849755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ef843-e9e0-4f89-abaf-6a683be0d751 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.851804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 68/137] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:06.860253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:06.860609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:06.860908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:06.882644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:06.883912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:06.967645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 69/138] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:06.981067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 70/139] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:06 2022] PUT /identity/v3/projects/f2925804921b45939d514246d9ae2dac/users/df0ccfdb6af840879aee5a3f4397093a/roles/3ad4a86440e943caac11daabeeb44957 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:07.003011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:07.048238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:07.120300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101b92-83d3-467c-8492-9b66443a88e5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:07.156327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916143-10d4-4873-a308-a6d3d908d99c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:07.156671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916143-10d4-4873-a308-a6d3d908d99c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:07.156904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916143-10d4-4873-a308-a6d3d908d99c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:07.158386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 71/140] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:07.164801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:07.171577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:07.171577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:07.184252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:07.185657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:07.186323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:07.189847 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:07.191410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:07.193163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:07.194342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:07.195740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:07.199742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 70/141] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:07.205353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:07.337303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 72/142] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:07.369419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:07.430055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218083a-2f4e-4687-8d49-929b9fa1f61a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:07.442183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:07.442455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:07.505621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:07.506639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:07.508620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:07.509200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:07.509977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:07.511512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:07.573367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f27137-38d0-46b1-b381-8b0d3be01cf1 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:07.622495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:07.623359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:07.623652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:07.623940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:07.626928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 71/143] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:07 2022] POST /identity/v3/users => generated 283 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:28:07.647196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:07.655884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:07.657518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:07.658273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:07.661443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 73/144] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:07.666150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:07.810028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92d05-fb63-491a-ae7a-a62663e5aaf3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:07.857230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:07.857995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:07.858287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:07.858575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:07.859361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:07.859675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:07.861110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:07.874259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 72/145] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:07.880241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:08.001487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:08.008389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fa20-28c0-46cd-913a-399d4038fd8c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:08.045727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:08.046609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:08.046900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:08.047188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] PATH_INFO: `/v3/users/a83749f1e9174968a577f6fa75ab1d46` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:08.048422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] RBAC: Authorizing `identity:get_user(user_id=a83749f1e9174968a577f6fa75ab1d46)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:08.049930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:08.051608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 74/146] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:07 2022] GET /identity/v3/users/a83749f1e9174968a577f6fa75ab1d46 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:08.057874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:08.088714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:08.177039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4ea14-3e65-4f2b-88d0-895481761135 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:08.212346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ecbc5-6725-4306-9232-3a7f505e3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:08.213349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecbc5-6725-4306-9232-3a7f505e3e8a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:08.213642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecbc5-6725-4306-9232-3a7f505e3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:08.213925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecbc5-6725-4306-9232-3a7f505e3e8a None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:08.215145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ecbc5-6725-4306-9232-3a7f505e3e8a None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:08.216632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ecbc5-6725-4306-9232-3a7f505e3e8a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:08.218716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 73/147] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:08 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:08.224343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:08.357322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0ec6-9b5f-4656-aa7f-545d17b2bbab None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:08.390500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d3637-8a1d-40eb-84d0-59879bd3b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:08.391721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3637-8a1d-40eb-84d0-59879bd3b3ea None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:08.392176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3637-8a1d-40eb-84d0-59879bd3b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:08.392618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3637-8a1d-40eb-84d0-59879bd3b3ea None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac/users/a83749f1e9174968a577f6fa75ab1d46/roles/4289c849c84d496592da62bc05d78f8d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:08.394979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d3637-8a1d-40eb-84d0-59879bd3b3ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f2925804921b45939d514246d9ae2dac, user_id=a83749f1e9174968a577f6fa75ab1d46, role_id=4289c849c84d496592da62bc05d78f8d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:08.397235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d3637-8a1d-40eb-84d0-59879bd3b3ea None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:08.473830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 75/148] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:08 2022] PUT /identity/v3/projects/f2925804921b45939d514246d9ae2dac/users/a83749f1e9174968a577f6fa75ab1d46/roles/4289c849c84d496592da62bc05d78f8d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:08.503454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25009a-53db-4e36-9a45-e291b64b3bcc None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:08.503779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25009a-53db-4e36-9a45-e291b64b3bcc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:08.504027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25009a-53db-4e36-9a45-e291b64b3bcc None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:08.505877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 74/149] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:08.515021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:08.515658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:08.516140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:08.542608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:08.544484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:08.570686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:08.629345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 76/150] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:08.674239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25009a-53db-4e36-9a45-e291b64b3bcc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:08.782668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:08.796447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25009a-53db-4e36-9a45-e291b64b3bcc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:08.842578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:08.843395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:08.843688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:08.843967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:08.859428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:08.867618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:08.868465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:08.869683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 75/151] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:08.874667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:09.043461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2068-2088-44a6-95b8-e63866e97252 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:09.081927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:09.083004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:09.083493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:09.084499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:09.085480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:09.085998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:09.087643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:09.100470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 77/152] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:09.105682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:09.261505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889f9e9-3ac4-4fa6-a318-9a0e08291c0d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:09.304828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:09.305700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:09.306001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:09.306272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:09.307550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:09.309063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:09.311306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 76/153] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:09 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:09.316605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:09.342501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:09.447444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218665-5d19-41ea-8ff0-79ec560add8f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:09.485248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:09.485958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:09.486250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:09.486536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:09.576650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:09.578132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:09.605419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:09.705118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 78/154] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:09.710451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:09.752298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:09.861125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4e181-ed40-4f64-a998-b1d0b0c0089c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:09.902110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddd80e-8c7c-482f-9ad3-bec37030e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:09.902977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddd80e-8c7c-482f-9ad3-bec37030e657 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:09.903264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddd80e-8c7c-482f-9ad3-bec37030e657 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:09.903547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddd80e-8c7c-482f-9ad3-bec37030e657 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:09.904760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddd80e-8c7c-482f-9ad3-bec37030e657 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:09.906264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddd80e-8c7c-482f-9ad3-bec37030e657 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:09.908006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 77/155] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:09 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:09.913796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:10.028371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c697-9cab-456e-813f-45de0f71ad0e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:10.049102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:10.069115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:10.069869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.070210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.070499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.071400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=df0ccfdb6af840879aee5a3f4397093a) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:10.071718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:10.073173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604647a9-0161-4673-907e-a284f7d8c6d2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:10.081476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 79/156] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:09 2022] GET /identity/v3/role_assignments?user.id=df0ccfdb6af840879aee5a3f4397093a&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=e446eb256dc14055b69a04a154fdc373 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:10.311406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bbfc1-a35d-45ac-b5eb-2ade2f6603c0 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.311740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bbfc1-a35d-45ac-b5eb-2ade2f6603c0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.311984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bbfc1-a35d-45ac-b5eb-2ade2f6603c0 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.313422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 78/157] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:10.319840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a39e-a0c9-4b2d-8f60-935b68add308 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.320248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a39e-a0c9-4b2d-8f60-935b68add308 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.320589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a39e-a0c9-4b2d-8f60-935b68add308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.346874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8b31a39e-a0c9-4b2d-8f60-935b68add308 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:10.348063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8b31a39e-a0c9-4b2d-8f60-935b68add308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:10.447661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 80/158] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:10.456624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3a440-64ee-49ca-bae0-225ffc8ee0ce None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.456929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3a440-64ee-49ca-bae0-225ffc8ee0ce None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.457180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3a440-64ee-49ca-bae0-225ffc8ee0ce None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.458626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 79/159] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:10.473317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.473642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.473870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.487863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3a440-64ee-49ca-bae0-225ffc8ee0ce None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:10.501159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:10.503010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:10.589782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 81/160] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:10.630094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:10.667084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:10.702980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3a440-64ee-49ca-bae0-225ffc8ee0ce None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:10.711105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:10.787616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:10.788452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.788745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.789029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.816596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05986603-6ede-4163-bb68-e58e98df11dc None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:10.822316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:10.830742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:10.831933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:10.832900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:10.837550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 80/161] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:10.842609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:10.887035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c03e3-2061-43cf-a632-86a71dc52d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:10.888095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c03e3-2061-43cf-a632-86a71dc52d20 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.888551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c03e3-2061-43cf-a632-86a71dc52d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.888971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c03e3-2061-43cf-a632-86a71dc52d20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.910550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c03e3-2061-43cf-a632-86a71dc52d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-c36c03e3-2061-43cf-a632-86a71dc52d20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:10.920576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:10.921676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:10.922636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:10.929888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 82/162] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:10.931447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fef4de-9517-42be-aa69-fb22da199c6b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.931934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fef4de-9517-42be-aa69-fb22da199c6b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.932378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fef4de-9517-42be-aa69-fb22da199c6b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.934408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 83/163] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:10.939888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:10.940367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:10.940895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:10.974665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:10.976767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:11.093607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 84/164] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:11.095041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.114014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd8df-074f-4745-9c95-a25d18d531ca None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.142596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:11.222162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.222866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.223154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.223435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:11.224200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:11.224760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:11.227689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:11.244233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dead8-9fc6-4e8b-8e0c-471bdcf69bed None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.247593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 81/165] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:11.248522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.268326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:11.326800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.327524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.327810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.328095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:11.328861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:11.329175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:11.330611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:11.340414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 85/166] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:11.341384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.401651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e181-58b7-4113-a51e-9725e485c237 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.441595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.442481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.442778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.443273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:11.455565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:11.464883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:11.465787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:11.466557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 82/167] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:11.467268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.557670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:11.578310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:11.586464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cc7ec-ee6e-4793-9355-729d5808510d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.605044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2701fa-f851-4840-8c63-689df63232df None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.670354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.671163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.671453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.671731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] PATH_INFO: `/v3/users/8935c834d03f4a008037c7655781e212` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:11.674486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=8935c834d03f4a008037c7655781e212)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:11.675980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:11.682372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 83/168] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/users/8935c834d03f4a008037c7655781e212 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:11.683763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.690397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.691294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.691588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.691867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:11.696924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:11.698519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:11.704967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 86/169] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:11.705883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.873650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927747b-10d6-49ff-8466-d3524f973aa3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.914802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.915483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.915747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfd879-598b-47b7-a27a-b203a18c5d5c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:11.916178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.916178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:11.916818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:11.917134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:11.918725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:11.925146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:11.935412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 84/170] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:11.938857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:11.969171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fa557-5a50-418c-926b-46724ce7effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:11.970194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa557-5a50-418c-926b-46724ce7effc None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:11.970681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa557-5a50-418c-926b-46724ce7effc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:11.971519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa557-5a50-418c-926b-46724ce7effc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.001978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.051088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fa557-5a50-418c-926b-46724ce7effc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.054060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fa557-5a50-418c-926b-46724ce7effc None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.073750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb3e5-9033-466d-b303-81a0e880c060 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.112089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e717b-0d06-47f1-a57b-9a17580b77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.113128 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e717b-0d06-47f1-a57b-9a17580b77e5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.113651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e717b-0d06-47f1-a57b-9a17580b77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.114138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e717b-0d06-47f1-a57b-9a17580b77e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.184310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 87/171] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:12.186033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c131c-da9a-461c-9c27-18b91c3caec4 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.186554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c131c-da9a-461c-9c27-18b91c3caec4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.187030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c131c-da9a-461c-9c27-18b91c3caec4 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.188629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 88/172] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:12.189565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c131c-da9a-461c-9c27-18b91c3caec4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.198968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.202569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e717b-0d06-47f1-a57b-9a17580b77e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.204933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e717b-0d06-47f1-a57b-9a17580b77e5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.258967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.319471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c131c-da9a-461c-9c27-18b91c3caec4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.332823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 85/173] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:12.335942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b47a-9c95-48d0-a0c3-b2c97dfc0028 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.336236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b47a-9c95-48d0-a0c3-b2c97dfc0028 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.336518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b47a-9c95-48d0-a0c3-b2c97dfc0028 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.338158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 86/174] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:12.338856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b47a-9c95-48d0-a0c3-b2c97dfc0028 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.365370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62590d8-e1aa-4677-9ee9-14a3d9fbef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.366675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62590d8-e1aa-4677-9ee9-14a3d9fbef31 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.367158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62590d8-e1aa-4677-9ee9-14a3d9fbef31 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.367629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62590d8-e1aa-4677-9ee9-14a3d9fbef31 None admin] PATH_INFO: `/v3/users/df0ccfdb6af840879aee5a3f4397093a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.369084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62590d8-e1aa-4677-9ee9-14a3d9fbef31 None admin] RBAC: Authorizing `identity:get_user(user_id=df0ccfdb6af840879aee5a3f4397093a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.370888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62590d8-e1aa-4677-9ee9-14a3d9fbef31 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.372857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 89/175] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/users/df0ccfdb6af840879aee5a3f4397093a => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:12.374343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.374831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.375573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.394163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:12.395711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:12.471853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 90/176] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:12.472441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.482120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.488967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b47a-9c95-48d0-a0c3-b2c97dfc0028 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.541588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5fb99-5c58-48b1-b734-b4b433566672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.542463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5fb99-5c58-48b1-b734-b4b433566672 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.542744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5fb99-5c58-48b1-b734-b4b433566672 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.543027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5fb99-5c58-48b1-b734-b4b433566672 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.544998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5fb99-5c58-48b1-b734-b4b433566672 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.546824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5fb99-5c58-48b1-b734-b4b433566672 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.549528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 87/177] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:12.550647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.550857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.551115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.559268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.572732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:12.574076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:12.603953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef07676-c829-402e-bb9e-1490925e05ea None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.640336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.641209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.641522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.641808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.643002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.644453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.653514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 88/178] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:12.653668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 91/179] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:12.653668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.653796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.753263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.756895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8298e-e54f-4f8d-8b8e-5c7ec7cbcc68 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.757402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30fcf1-9dab-4a4f-998b-839688a262d8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.782383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.791002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd205-7419-4617-8633-ef4a9fb63b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.791434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.791828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd205-7419-4617-8633-ef4a9fb63b1f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.791925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.792113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd205-7419-4617-8633-ef4a9fb63b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.792202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.792468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.792575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd205-7419-4617-8633-ef4a9fb63b1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.803533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcd205-7419-4617-8633-ef4a9fb63b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-21dcd205-7419-4617-8633-ef4a9fb63b1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:12.811399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:12.812276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:12.813045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 92/180] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:12.814182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab855b88-0c1a-45b0-a6ad-40e8a6c1fdbb None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.814182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab855b88-0c1a-45b0-a6ad-40e8a6c1fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.814402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab855b88-0c1a-45b0-a6ad-40e8a6c1fdbb None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.815782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 93/181] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:12.816477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab855b88-0c1a-45b0-a6ad-40e8a6c1fdbb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.867487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.869004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab855b88-0c1a-45b0-a6ad-40e8a6c1fdbb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:12.953505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:12.954152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:12.954432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:12.954707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:12.955559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=8935c834d03f4a008037c7655781e212) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:12.955871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:12.957339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:12.962446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:12.963622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 94/182] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/role_assignments?user.id=8935c834d03f4a008037c7655781e212&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:12.964404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:12.967933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 89/183] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:12.969022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.025372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.082945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2d326-5a1b-48d7-a48d-c9260bb31caf None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.086672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c064-b6fd-4af5-a857-69137e01bfb2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.121329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.122288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.122726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.123258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.124120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] RBAC: Adding query filter params (role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=df0ccfdb6af840879aee5a3f4397093a) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:13.124442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.125996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e1879-8775-4246-ad7f-6b9b1b90cdc3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.126221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5421c-c888-4916-90f7-884f7fe24ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.127054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5421c-c888-4916-90f7-884f7fe24ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.127299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5421c-c888-4916-90f7-884f7fe24ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.127572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5421c-c888-4916-90f7-884f7fe24ce6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.135343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 95/184] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/role_assignments?user.id=df0ccfdb6af840879aee5a3f4397093a&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=3ad4a86440e943caac11daabeeb44957 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.136654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223fded-5511-4408-b838-3018781ca9e5 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.136943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223fded-5511-4408-b838-3018781ca9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.137222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223fded-5511-4408-b838-3018781ca9e5 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.139846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 96/185] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:13.139846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223fded-5511-4408-b838-3018781ca9e5 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.145931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5421c-c888-4916-90f7-884f7fe24ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-51a5421c-c888-4916-90f7-884f7fe24ce6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:13.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:13.155852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:13.156656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 90/186] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:13.163637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.163637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.163637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.179222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:13.180473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:13.263435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.275146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223fded-5511-4408-b838-3018781ca9e5 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.285457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 91/187] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:13.285457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.301053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.324807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.325535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.325829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.326115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.327682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:13.328003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.329524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5bafa-5494-4a55-a39c-d4dc41e09d42 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.340468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 97/188] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.341787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.342133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.344614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.361820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:13.363679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:13.399119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f5f89-6d06-43ac-a68d-49cb8e98d5cc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.436387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.437788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.438272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.438729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] PATH_INFO: `/v3/projects/cb146ec0941c40cb8480da868c21576c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.440055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 98/189] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:13.441570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.441743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] RBAC: Authorizing `identity:get_project(project_id=cb146ec0941c40cb8480da868c21576c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.443925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.452295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 92/190] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/projects/cb146ec0941c40cb8480da868c21576c => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.452295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.509612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.554672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c717bc-23dc-49df-8ed5-b3acc7e0c7a9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.554853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222abb87-5615-491b-a05e-1879e0437a83 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.562820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.588862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.589057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.589757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.589873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.589975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.590051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.590249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.590335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.591064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:13.591378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.592767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.602010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:13.602739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 99/191] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.603528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:13.611833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:13.612714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:13.613744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 93/192] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:13.614626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.706307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49bb7-1b9f-4782-a35c-bc6e303a21b9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.714287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370041f-6aac-43de-9372-ebad2e8d589f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.730028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.740602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.741492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.741773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.742048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] PATH_INFO: `/v3/users/b957497c67ac48dc9943cf0dbffeef2d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.751080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.751080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.751080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.751080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.751384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=cb146ec0941c40cb8480da868c21576c, user.id=df0ccfdb6af840879aee5a3f4397093a) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:13.751384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.751616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.758477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 94/193] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/role_assignments?user.id=df0ccfdb6af840879aee5a3f4397093a&scope.project.id=cb146ec0941c40cb8480da868c21576c&role.id=e446eb256dc14055b69a04a154fdc373 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.758624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] RBAC: Authorizing `identity:get_user(user_id=b957497c67ac48dc9943cf0dbffeef2d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.759277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.760052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.766269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 100/194] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/users/b957497c67ac48dc9943cf0dbffeef2d => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.766269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.798209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:13.881537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e406-ede9-44c8-ba7d-d5c0f78c6fce None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.884323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf3357-0169-43b9-82ec-4107854c5869 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:13.921160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.922426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.922426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.922626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] PATH_INFO: `/v3/users/a83749f1e9174968a577f6fa75ab1d46` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.923828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] RBAC: Authorizing `identity:get_user(user_id=a83749f1e9174968a577f6fa75ab1d46)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.924245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:13.925193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:13.925342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.925776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:13.926221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:13.926935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 101/195] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/users/a83749f1e9174968a577f6fa75ab1d46 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.928184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:13.928974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.929916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:13.931730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 95/196] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:13.932357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:13.999127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.033544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.041077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02f51-93f3-4e4f-b518-6cde9437a64f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.051025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb099d0-171b-46f6-8fba-78625c50dc66 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.075957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.076624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.076909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.077184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.077966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:14.078274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.079648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.084998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.085792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.086080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.086360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.088604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 102/197] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:14.089392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.153704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.155096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.190570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee4825-1cd1-4c17-bcaf-4e517d909fbb None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.204070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.223773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.225522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.225806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.226085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.226802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.228309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.257294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 96/198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:14.258141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.340593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 103/199] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:14 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:14.341463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.369470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.384829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3b4e-9acc-406d-8b71-071baa356b4b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.426711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.428105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.428381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.428678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.449905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.468011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae486-3fde-47fb-a85e-b9bbcee10062 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.509616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.510697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.511120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.511568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.511854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.512135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] PATH_INFO: `/v3/users/b957497c67ac48dc9943cf0dbffeef2d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.515522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] RBAC: Authorizing `identity:get_user(user_id=b957497c67ac48dc9943cf0dbffeef2d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.516205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.518104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 104/200] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:14 2022] GET /identity/v3/users/b957497c67ac48dc9943cf0dbffeef2d => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:14.518716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.622102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.645126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 97/201] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:14.646609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.646717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48208-99be-44dc-a96c-9ffd3ee9c784 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.692666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.694723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.695014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.695288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.696998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.698595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.701269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 105/202] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:14 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:14.702282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.717743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.789886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed794439-8f53-40c5-9aa2-8e4bb62e980a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.821537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3fb9-4778-4080-ba9a-c8c776bf8286 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:14.837040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.838212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.838504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.839046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.859992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:14.860971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:14.861265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:14.861572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:14.862972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.864536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.866549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 106/203] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:14 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:14.867482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:14.889385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.929131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:14.930644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:14.985495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:14.995537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29047376-a74d-44fa-91a5-bdde063dde9e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:15.031159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:15.031831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:15.032124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:15.032416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:15.033268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=b957497c67ac48dc9943cf0dbffeef2d) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:15.033707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:15.035064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:15.041965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 107/204] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:14 2022] GET /identity/v3/role_assignments?user.id=b957497c67ac48dc9943cf0dbffeef2d&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:15.046268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:15.051178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 98/205] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:15.054124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:15.183701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb666-a8a7-44ce-bc3d-d62d9aba24be None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:15.220452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:15.221988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:15.222446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:15.222891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:15.224868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:15.226671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:15.233409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 99/206] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:15 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:15.235127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:15.253751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:15.272814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:15.293508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66df1-2052-4a7f-b25c-604c8cf78f44 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:15.361597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:15.362255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:15.362539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:15.362822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:15.363657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] RBAC: Adding query filter params (role.id=4289c849c84d496592da62bc05d78f8d, scope.project.id=f2925804921b45939d514246d9ae2dac, user.id=a83749f1e9174968a577f6fa75ab1d46) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:15.363969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:15.365676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c9b43-0449-4cda-8491-b39dc4962747 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:15.381596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 108/207] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:15 2022] GET /identity/v3/role_assignments?user.id=a83749f1e9174968a577f6fa75ab1d46&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=4289c849c84d496592da62bc05d78f8d => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:15.419396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97773-28ad-4540-8a2d-b1ece50bbbbf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:15.463616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:15.464282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:15.464564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:15.464844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:15.465713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] RBAC: Adding query filter params (role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=b957497c67ac48dc9943cf0dbffeef2d) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:15.466025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:15.467488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ada276-fe6a-422b-80e6-db75885f13b5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:15.481410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 100/208] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:15 2022] GET /identity/v3/role_assignments?user.id=b957497c67ac48dc9943cf0dbffeef2d&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=3ad4a86440e943caac11daabeeb44957 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:16.600631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ca18-f20a-46d9-9368-ca5f1e9bb28b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:16.601138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ca18-f20a-46d9-9368-ca5f1e9bb28b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:16.601240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6ca18-f20a-46d9-9368-ca5f1e9bb28b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:16.602802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 109/209] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:16.607999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8f298-9693-4823-8940-26451b03c092 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:16.608406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8f298-9693-4823-8940-26451b03c092 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:16.608573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8f298-9693-4823-8940-26451b03c092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:16.625581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-43d8f298-9693-4823-8940-26451b03c092 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:16.626765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43d8f298-9693-4823-8940-26451b03c092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:16.702079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 101/210] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:16.725769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ca18-f20a-46d9-9368-ca5f1e9bb28b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:16.745373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d8df8-6498-4f36-b470-a7708747eafb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:16.745663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d8df8-6498-4f36-b470-a7708747eafb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:16.746053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d8df8-6498-4f36-b470-a7708747eafb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:16.747851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 102/211] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:16.752861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:16.753148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:16.753568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:16.771701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:16.772894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:16.776548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:16.851416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6ca18-f20a-46d9-9368-ca5f1e9bb28b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:16.869389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 103/212] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:16.888895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:16.893794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:16.894596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:16.894882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:16.895161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:16.907149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:16.916523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:16.917455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:16.919327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 110/213] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:16.923514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:16.932137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.026574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9ef34-a79f-483c-b002-d43e77c46aec None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.037092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa75d-158e-48e9-9aab-51af506d6028 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.074629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.075404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.075691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.075972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.076728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:17.077039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:17.077413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.078440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.078544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:17.079009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.079489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.081530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:17.083239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:17.087077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 104/214] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:17.092458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 111/215] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:17.097043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.098573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.109695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.177964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.211794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e050f-3d1d-4430-afaa-b66259f3f638 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.226358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d1a1-a62b-42d6-8c08-9a43bbc1daf2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.248473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5fba-c41d-4ac7-866c-ccc2c36c53de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.249156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5fba-c41d-4ac7-866c-ccc2c36c53de None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.249494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5fba-c41d-4ac7-866c-ccc2c36c53de None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.249951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5fba-c41d-4ac7-866c-ccc2c36c53de None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.250480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf5fba-c41d-4ac7-866c-ccc2c36c53de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:17.251925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf5fba-c41d-4ac7-866c-ccc2c36c53de None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:17.276716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8915e61-d3a2-415e-864a-40cf611e88e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.279415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8915e61-d3a2-415e-864a-40cf611e88e5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.279415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8915e61-d3a2-415e-864a-40cf611e88e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.279415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8915e61-d3a2-415e-864a-40cf611e88e5 None admin] PATH_INFO: `/v3/users/97fcf1c7d48845b1b92a2fc7267567c3` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.294757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8915e61-d3a2-415e-864a-40cf611e88e5 None admin] RBAC: Authorizing `identity:get_user(user_id=97fcf1c7d48845b1b92a2fc7267567c3)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:17.296308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8915e61-d3a2-415e-864a-40cf611e88e5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:17.298139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 112/216] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:17 2022] GET /identity/v3/users/97fcf1c7d48845b1b92a2fc7267567c3 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:17.299372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054460a-7ffb-490f-9c50-84121ec4d0a7 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.299706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054460a-7ffb-490f-9c50-84121ec4d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.299985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054460a-7ffb-490f-9c50-84121ec4d0a7 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.303505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 113/217] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:17.304123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054460a-7ffb-490f-9c50-84121ec4d0a7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.355308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 105/218] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:17 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:17.363143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.363400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.363886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.390822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:17.393044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:17.424956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054460a-7ffb-490f-9c50-84121ec4d0a7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.454279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.466295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7163f-4a19-4348-a125-c8a3af603079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.467364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7163f-4a19-4348-a125-c8a3af603079 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.467850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7163f-4a19-4348-a125-c8a3af603079 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.468327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7163f-4a19-4348-a125-c8a3af603079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.482994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.495614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 106/219] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:17.520859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.555491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7163f-4a19-4348-a125-c8a3af603079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:17.558222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7163f-4a19-4348-a125-c8a3af603079 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:17.654263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd697-a749-43b1-928e-2826c4e5212d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.698397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.699201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.699550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.699748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.700114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 114/220] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:17.702361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4ebb-3cf1-4d83-844f-6d9af08cb7d9 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.703157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4ebb-3cf1-4d83-844f-6d9af08cb7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.703639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4ebb-3cf1-4d83-844f-6d9af08cb7d9 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.705523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 115/221] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:17.711846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.712389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.712848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.718427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:17.728296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:17.729202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:17.730058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:17.734559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 107/222] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:17.734559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.738108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:17.740240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:17.760051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.806745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:17.823065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 116/223] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:17.829478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.876199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ced36f-6344-4fb3-a45f-14af46be7bad None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:17.923192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:17.924332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:17.924622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:17.924906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:17.926795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:17.929867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:17.932923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 108/224] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:17 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:17.933547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:17.974598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31f2a0-ad12-44b3-ba47-8517205c314f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.013737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.014927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.015454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.016026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.017120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:18.017802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.019754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.030835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 117/225] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:18.032274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.069838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bbf14-d99b-4a86-bb06-6b6ad2e5d0fd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.073649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:18.096351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:18.112325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26414217-2132-449c-8bc2-a708087b963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.113838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414217-2132-449c-8bc2-a708087b963e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.114599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414217-2132-449c-8bc2-a708087b963e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.115029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414217-2132-449c-8bc2-a708087b963e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.129493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26414217-2132-449c-8bc2-a708087b963e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-26414217-2132-449c-8bc2-a708087b963e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:18.140439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:18.141771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:18.142781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:18.149442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 109/226] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:18.151540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26414217-2132-449c-8bc2-a708087b963e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.169490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ade5d-b809-4731-848e-7f38f688d9b6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.205173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.206759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.207313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.207793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.210183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=97fcf1c7d48845b1b92a2fc7267567c3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:18.211123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.213351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.222232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 118/227] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:18 2022] GET /identity/v3/role_assignments?user.id=97fcf1c7d48845b1b92a2fc7267567c3&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=e446eb256dc14055b69a04a154fdc373 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:18.223490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.350890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26414217-2132-449c-8bc2-a708087b963e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.385674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:18.393798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.395323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.396353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.396949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] PATH_INFO: `/v3/users/b957497c67ac48dc9943cf0dbffeef2d` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.398943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] RBAC: Authorizing `identity:get_user(user_id=b957497c67ac48dc9943cf0dbffeef2d)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.400612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.402721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 110/228] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:18 2022] GET /identity/v3/users/b957497c67ac48dc9943cf0dbffeef2d => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:18.414881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.433225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04011f-7ace-4775-816c-20ca37ae9162 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.478944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:18.486206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.486763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.487112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.487401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.488222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:18.488543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.490408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.516911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 119/229] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:18.527806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.540587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3289b-d75d-416b-951b-10d4fea23225 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.579684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.580983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.582914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.583687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.586192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.588088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.591624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 111/230] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:18 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:18.597818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.741475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69203773-315e-423c-85fd-865d6d5d3228 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.806518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fc66-5bcc-4039-896e-b7b5e3ee91a4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.821781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.822712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.823001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.823282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] PATH_INFO: `/v3/users/b957497c67ac48dc9943cf0dbffeef2d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.826714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] RBAC: Authorizing `identity:get_user(user_id=b957497c67ac48dc9943cf0dbffeef2d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.828184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.830754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 120/231] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:18 2022] GET /identity/v3/users/b957497c67ac48dc9943cf0dbffeef2d => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:18.836336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:18.854402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:18.856295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:18.889588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:18.890496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:18.892096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:18.893169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/b957497c67ac48dc9943cf0dbffeef2d/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:18.895953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cad7076bb634184b26c7fbcf79495a5, user_id=b957497c67ac48dc9943cf0dbffeef2d, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:18.897444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:18.972281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808959-ab20-49cb-a243-78aed35c1060 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:18.979121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 112/232] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:18 2022] PUT /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/b957497c67ac48dc9943cf0dbffeef2d/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:28:19.010862 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32117ae-6656-443a-b3be-4acc7b2cf9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:19.012049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32117ae-6656-443a-b3be-4acc7b2cf9ce None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:19.012584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32117ae-6656-443a-b3be-4acc7b2cf9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:19.013041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32117ae-6656-443a-b3be-4acc7b2cf9ce None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:19.014604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32117ae-6656-443a-b3be-4acc7b2cf9ce None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:19.016288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32117ae-6656-443a-b3be-4acc7b2cf9ce None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:19.023303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 121/233] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:18 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:19.024911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:19.169620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975abff-3867-4df7-8b8d-493bc33bc0b4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:19.216228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0c53f-1945-4782-996c-63b658544b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:19.217454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0c53f-1945-4782-996c-63b658544b6c None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:19.217924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0c53f-1945-4782-996c-63b658544b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:19.218434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0c53f-1945-4782-996c-63b658544b6c None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/b957497c67ac48dc9943cf0dbffeef2d/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:19.221290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0c53f-1945-4782-996c-63b658544b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=5cad7076bb634184b26c7fbcf79495a5, user_id=b957497c67ac48dc9943cf0dbffeef2d, role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:19.222963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0c53f-1945-4782-996c-63b658544b6c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:19.342593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 113/234] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:19 2022] PUT /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/b957497c67ac48dc9943cf0dbffeef2d/roles/3ad4a86440e943caac11daabeeb44957 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:19.875726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd934f-b0ee-4d41-8694-871198c7b3fd None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:19.876247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd934f-b0ee-4d41-8694-871198c7b3fd None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:19.876352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd934f-b0ee-4d41-8694-871198c7b3fd None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:19.878035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 122/235] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:19.883691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:19.884121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:19.884317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:19.904829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:19.906052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:19.931213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372309fe-b24b-4885-875f-a055e06d1eab None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:19.931505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372309fe-b24b-4885-875f-a055e06d1eab None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:19.931783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372309fe-b24b-4885-875f-a055e06d1eab None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:19.933444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 123/236] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:19.938301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:19.938590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:19.938868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:19.944444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:19.966998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:19.968611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:20.003823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 114/237] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:20.040742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:20.048422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 124/238] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:20.089760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:20.104551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:20.155467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76437d-d41c-4d07-943a-b0f0779a69d4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:20.196428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:20.197693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.199540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.199998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.224761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:20.232577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:20.233570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:20.234388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:20.238270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 115/239] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:20.246905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:20.293898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfff3a-6944-4c5d-b234-fba1b3ffea3b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:20.309702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:20.366589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:20.367399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.367692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.367994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.370150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:20.371777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:20.373803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 125/240] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:20.379003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:20.409496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12399e4-2f20-4219-9883-f9e8a4ceac8f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:20.444577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:20.445269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.445587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.445876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.446666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:20.446991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:20.448417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:20.461396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 116/241] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:20.462970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:20.533874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:20.580032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dbe6-57fd-41ef-9c17-2feb7e65b02c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:20.613595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284f290-2c5a-4a29-a468-7075a961a80e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:20.621641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:20.624529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec3e1-4bb6-42a3-b1c7-618f9688b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:20.625454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec3e1-4bb6-42a3-b1c7-618f9688b113 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.625940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec3e1-4bb6-42a3-b1c7-618f9688b113 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.626409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec3e1-4bb6-42a3-b1c7-618f9688b113 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.627339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ec3e1-4bb6-42a3-b1c7-618f9688b113 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:20.628989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ec3e1-4bb6-42a3-b1c7-618f9688b113 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:20.649820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:20.650763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.651055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.651337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] PATH_INFO: `/v3/users/26e8e56e5ed14b2c8377be0d5a7186b2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.666750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] RBAC: Authorizing `identity:get_user(user_id=26e8e56e5ed14b2c8377be0d5a7186b2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:20.668274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:20.670372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 117/242] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:20 2022] GET /identity/v3/users/26e8e56e5ed14b2c8377be0d5a7186b2 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:20.676041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:20.730345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 126/243] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:20 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:28:20.732143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620c39b-832c-42dd-bcae-f6373a791e71 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.732636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620c39b-832c-42dd-bcae-f6373a791e71 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.733084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620c39b-832c-42dd-bcae-f6373a791e71 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.734687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 127/244] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:20.741188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.741507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.741910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.761629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:20.763300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:20.794361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a159-daae-42d6-a2f8-f46c2436765c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:20.831531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:20.832214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:20.832485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:20.832771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:20.853727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:20.902962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 128/245] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:20.922751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:20.924191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:20.944762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.036988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:21.087209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 118/246] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:21.088688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123b47-7570-4661-8caf-a67df85a2cd7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.094469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.142255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.144323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.144843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.146203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.162760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:21.164018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:21.172557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:21.177988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:21.178786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 129/247] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:21.180492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.234230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420235-5684-4246-8d73-2b349fc3c5b8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.286073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.302408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.302408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.302408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.302408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:21.302408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:21.302408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 119/248] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:21.302941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.316485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71381a3c-1359-42af-b3bb-f108c9ef894d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.349633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:21.363864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.364619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.364908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.365191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.365983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:21.366302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:21.367703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f28a4c-065e-4b35-946e-fb220e676800 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:21.378031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 130/249] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:21.379324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eff9-001b-411d-9aea-486c96cde324 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.379764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eff9-001b-411d-9aea-486c96cde324 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.380379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eff9-001b-411d-9aea-486c96cde324 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.385972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 131/250] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:21.387454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4eff9-001b-411d-9aea-486c96cde324 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.455005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e48cab-80e4-4de9-b278-c79824fb87f8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.475757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:21.497771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.498530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.501601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.501601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.501601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] RBAC: Adding query filter params (role.id=4289c849c84d496592da62bc05d78f8d, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=26e8e56e5ed14b2c8377be0d5a7186b2) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:21.501601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:21.502128 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae464-2d75-454d-9809-85005bd0ee2e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:21.508623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4eff9-001b-411d-9aea-486c96cde324 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.513332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 120/251] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/role_assignments?user.id=26e8e56e5ed14b2c8377be0d5a7186b2&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=4289c849c84d496592da62bc05d78f8d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:21.514122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.514484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.514837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.534805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:21.536338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:21.579654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.580958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.581452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.581932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] PATH_INFO: `/v3/users/97fcf1c7d48845b1b92a2fc7267567c3` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.584416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] RBAC: Authorizing `identity:get_user(user_id=97fcf1c7d48845b1b92a2fc7267567c3)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:21.586204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:21.588471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 132/252] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/users/97fcf1c7d48845b1b92a2fc7267567c3 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:21.593904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.621939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 121/253] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:21.647156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.696445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:21.768247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c110-863f-4a41-9852-bcbff246a985 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.793154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:21.809696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.810692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.811212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.811677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.824378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:21.831553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f4362-ca1b-460f-b53b-3d38106926d1 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:21.834040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:21.834923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:21.835716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:21.836976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 122/254] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:21.842562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.870721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:21.871629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:21.871928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:21.872252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:21.874453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:21.875986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:21.878160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 133/255] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:21.886500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:21.995438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48210ac-d717-469a-988d-18e19066b39c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.034803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.036049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.036540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.037014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.038037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:22.038596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:22.040213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:22.050649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 123/256] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:22.057565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:22.079844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df225d-52e6-4cce-9055-4d5eb862ab3d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.110199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:22.126548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:22.141629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02ffce-f41b-4270-ac67-dcc3f6e864e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.142529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ffce-f41b-4270-ac67-dcc3f6e864e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.142812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ffce-f41b-4270-ac67-dcc3f6e864e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.143090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02ffce-f41b-4270-ac67-dcc3f6e864e1 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/97fcf1c7d48845b1b92a2fc7267567c3/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.148823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02ffce-f41b-4270-ac67-dcc3f6e864e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cad7076bb634184b26c7fbcf79495a5, user_id=97fcf1c7d48845b1b92a2fc7267567c3, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:22.150327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02ffce-f41b-4270-ac67-dcc3f6e864e1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:22.214905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa09f-5c17-4ea4-9ffc-4e35a5725fa6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.232866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 134/257] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:21 2022] PUT /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/97fcf1c7d48845b1b92a2fc7267567c3/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:22.238761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f6d28-733c-4539-8498-4cc4eff8d9ef None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.239074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f6d28-733c-4539-8498-4cc4eff8d9ef None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.240131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f6d28-733c-4539-8498-4cc4eff8d9ef None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.242127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 135/258] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:22.250952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.251250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.251517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.267122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.269516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.269516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.269516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] PATH_INFO: `/v3/users/b957497c67ac48dc9943cf0dbffeef2d` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.273337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] RBAC: Authorizing `identity:get_user(user_id=b957497c67ac48dc9943cf0dbffeef2d)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:22.273337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:22.274070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 124/259] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/users/b957497c67ac48dc9943cf0dbffeef2d => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:22.282538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:22.286496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:22.287674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:22.436147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 136/260] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:22.462911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:22.494419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:22.498022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f91a8-0792-4a02-9095-fed28b4e8d81 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.539199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.539791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.540084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.540372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.666377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9b33-c2e3-4f8b-b7b0-207db447c2a5 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.678816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:22.687492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:22.689009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:22.704969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.705856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.706146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.706428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.719625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:22.733327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:22.734281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:22.735070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 137/261] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:22.736521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:22.828428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:22.832389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 125/262] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:22.839014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:22.854776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a0bf-93c1-4b6d-970a-4a2e654ac3c8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.895044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.896360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.896762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.897107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.898027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:22.898347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:22.899763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:22.913031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 138/263] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:22.916908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:22.948788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085852-43f0-4ba5-a97d-4dcf1a0975e0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:22.954416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:22.985772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:22.987018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:22.987503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:22.987979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:22.989430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:22.991154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:22.997494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 126/264] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:22.999784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:23.034568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1efae0-35a5-400a-8cc0-f147163c3883 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:23.074014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:23.075052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:23.075344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:23.075728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] PATH_INFO: `/v3/users/b957497c67ac48dc9943cf0dbffeef2d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:23.077062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:23.078191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] RBAC: Authorizing `identity:get_user(user_id=b957497c67ac48dc9943cf0dbffeef2d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:23.080062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:23.082691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 139/265] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/users/b957497c67ac48dc9943cf0dbffeef2d => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:23.089203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:23.113139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c40cae-8f10-4f9c-ad61-99e8e736862c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:23.150282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:23.151116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:23.151503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:23.151905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:23.152923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=b957497c67ac48dc9943cf0dbffeef2d) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:23.153376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:23.154979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:23.162196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 127/266] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:22 2022] GET /identity/v3/role_assignments?user.id=b957497c67ac48dc9943cf0dbffeef2d&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:23.211074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:23.215342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d713bce-3aef-43e1-a5c0-b64c20aa4637 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:23.255700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:23.256656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:23.257094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:23.257552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:23.345382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:23.347177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:23.448811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:23.452486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 140/267] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:23.458594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:23.576258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760904-e84e-44aa-bf7e-9a2d11a3fd67 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:23.608948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:23.619010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1c554-a436-4329-9345-41ef22a49703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:23.625054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1c554-a436-4329-9345-41ef22a49703 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:23.625054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1c554-a436-4329-9345-41ef22a49703 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:23.625054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1c554-a436-4329-9345-41ef22a49703 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:23.625054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1c554-a436-4329-9345-41ef22a49703 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:23.625054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1c554-a436-4329-9345-41ef22a49703 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:23.625054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 128/268] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:23 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:23.631294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:23.746880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3be57-b445-42e5-8cb7-e4d58f43c93e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:23.782468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:23.783180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:23.783470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:23.783801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:23.784653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] RBAC: Adding query filter params (role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=b957497c67ac48dc9943cf0dbffeef2d) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:23.784970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:23.787101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073806de-5e48-4fca-837b-45877d7aa03f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:23.795098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 141/269] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:23 2022] GET /identity/v3/role_assignments?user.id=b957497c67ac48dc9943cf0dbffeef2d&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=3ad4a86440e943caac11daabeeb44957 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:24.132631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533bbf4-8ab7-45ac-83c8-4c99dbbbe076 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.133138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533bbf4-8ab7-45ac-83c8-4c99dbbbe076 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.133214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533bbf4-8ab7-45ac-83c8-4c99dbbbe076 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.134637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 129/270] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:24.140149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957aa6-9265-467f-8595-18c9b6a954fa None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.140594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957aa6-9265-467f-8595-18c9b6a954fa None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.140770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957aa6-9265-467f-8595-18c9b6a954fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.160379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d3957aa6-9265-467f-8595-18c9b6a954fa None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:24.162200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d3957aa6-9265-467f-8595-18c9b6a954fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:24.239613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:24.249602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 142/271] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:24.275151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533bbf4-8ab7-45ac-83c8-4c99dbbbe076 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:24.354742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b59b-1c3d-4159-9e28-d41f6060f216 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.355027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b59b-1c3d-4159-9e28-d41f6060f216 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.355345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b59b-1c3d-4159-9e28-d41f6060f216 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.357994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 143/272] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:24.361930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.362224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.362570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.381324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:24.382537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:24.402163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533bbf4-8ab7-45ac-83c8-4c99dbbbe076 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:24.447488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:24.449180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.449661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.450263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.469208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 144/273] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:24.469581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:24.484195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:24.485083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:24.486026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 130/274] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:24.488345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:24.494203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:24.584125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:24.598645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eeed4-ac85-4ef8-adf9-28977380269f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:24.622998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:24.634908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:24.635586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.635877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.636227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.637030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:24.637449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:24.638954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46df89-91fd-45e9-8c4f-999f009e65c5 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:24.639067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:24.651138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 145/275] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:24.657709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:24.681697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:24.682790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.682900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.683150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.684393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:24.685915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:24.689064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 131/276] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:24.697210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:24.779498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa3c36-8f30-4053-88b2-9f11e7053b74 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:24.811157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2002ab-574f-42f7-86a8-76f3ee637a7f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:24.817608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:24.818517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.818915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.819205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] PATH_INFO: `/v3/users/82e22b23fb764bb0978e26dbcc006e1e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.834356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] RBAC: Authorizing `identity:get_user(user_id=82e22b23fb764bb0978e26dbcc006e1e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:24.836127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:24.843091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:24.843250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 146/277] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:24 2022] GET /identity/v3/users/82e22b23fb764bb0978e26dbcc006e1e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:24.844585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:24.852533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f97a11-433d-4410-be9c-16c9335e1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:24.860622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f97a11-433d-4410-be9c-16c9335e1b2b None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.860622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f97a11-433d-4410-be9c-16c9335e1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.860622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f97a11-433d-4410-be9c-16c9335e1b2b None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.860622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f97a11-433d-4410-be9c-16c9335e1b2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:24.860622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f97a11-433d-4410-be9c-16c9335e1b2b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:24.896901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:24.953898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ba3a-4efb-48b0-a405-acd3d267a75d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:24.966760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 132/278] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:24 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:24.968056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899a93d-2614-4ddb-8745-53391f8793ec None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.969464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899a93d-2614-4ddb-8745-53391f8793ec None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.969464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899a93d-2614-4ddb-8745-53391f8793ec None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:24.974695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 133/279] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:24.976393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496290c-9ddf-4e63-8826-d45e36304084 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:24.976682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496290c-9ddf-4e63-8826-d45e36304084 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:24.976964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496290c-9ddf-4e63-8826-d45e36304084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.002802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6496290c-9ddf-4e63-8826-d45e36304084 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:25.003840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6496290c-9ddf-4e63-8826-d45e36304084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:25.014911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.016443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.016955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.017835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.019217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, user.id=82e22b23fb764bb0978e26dbcc006e1e, scope.system=all) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:25.019702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:25.022085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:25.033741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 147/280] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Jun 21 16:28:24 2022] GET /identity/v3/role_assignments?user.id=82e22b23fb764bb0978e26dbcc006e1e&scope.system=all&role.id=e446eb256dc14055b69a04a154fdc373 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:25.094371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 134/281] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:25.119950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.137038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15f76-dc1a-4c2f-a19f-54f9584473c5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.137622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15f76-dc1a-4c2f-a19f-54f9584473c5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.137802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15f76-dc1a-4c2f-a19f-54f9584473c5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.139787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 135/282] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:25.146387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.146690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.146970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.166717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:25.168912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:25.260954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e00d6-dcb7-4635-9a02-920b733bdb24 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:25.273332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 136/283] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:25.273507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:25.295936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.310555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.311490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.311780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.312062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.326027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:25.338509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:25.343020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:25.343828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 148/284] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:25.349456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.355876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:25.427310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ced22-d736-4bb4-a589-8ef5a097cbcd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:25.480718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.482037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.482542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.483034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.501039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:25.502428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf9103-3b20-47e6-a3a7-bc26fa7c4d21 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:25.511427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:25.512350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:25.513149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 137/285] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:25.520088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.553425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.554941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.555682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.556154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.557812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:25.558304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:25.560439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:25.573067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 149/286] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:25.578865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.636144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:25.672933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8a0b-279c-4e38-b31f-5e4a418edd63 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:25.676605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:25.747113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.747802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.748093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.750518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.750518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:25.750518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:25.750877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:25.761139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 138/287] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:25.775524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.784847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9abcc-bebe-4c5a-9f4e-bf11ea41a346 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:25.835424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.836664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.837190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.837810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] PATH_INFO: `/v3/users/26e8e56e5ed14b2c8377be0d5a7186b2` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.839576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] RBAC: Authorizing `identity:get_user(user_id=26e8e56e5ed14b2c8377be0d5a7186b2)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:25.841550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:25.844108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 150/288] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/users/26e8e56e5ed14b2c8377be0d5a7186b2 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:25.851405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:25.941699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd3e9-9aa4-4b6a-9fa3-7cb617a7be3b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:25.987067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:25.988377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:25.988910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:25.989875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] PATH_INFO: `/v3/users/97fcf1c7d48845b1b92a2fc7267567c3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:25.992042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] RBAC: Authorizing `identity:get_user(user_id=97fcf1c7d48845b1b92a2fc7267567c3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:25.994507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:25.998256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 139/289] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/users/97fcf1c7d48845b1b92a2fc7267567c3 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:26.008124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:26.018271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:26.024077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aaf92-ebed-45d3-ac0e-d3f09ec199f3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:26.056714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:26.071186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:26.072986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:26.073510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:26.074324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:26.078752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:26.080062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:26.090140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 151/290] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:25 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:26.101496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:26.204831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa702-dc90-4734-addb-daee9961782e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:26.267106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:26.267782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:26.268066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:26.269004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:26.295471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829c93-abbc-4ac6-b88a-e1193bb9af09 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:26.361259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:26.362690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:26.378568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:26.379544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:26.379859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:26.380180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/26e8e56e5ed14b2c8377be0d5a7186b2/roles/4289c849c84d496592da62bc05d78f8d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:26.386116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] RBAC: Authorizing `identity:create_grant(project_id=5cad7076bb634184b26c7fbcf79495a5, user_id=26e8e56e5ed14b2c8377be0d5a7186b2, role_id=4289c849c84d496592da62bc05d78f8d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:26.387589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:26.400954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:26.481873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 140/291] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:26.487384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 152/292] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:28:26 2022] PUT /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5/users/26e8e56e5ed14b2c8377be0d5a7186b2/roles/4289c849c84d496592da62bc05d78f8d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:28:26.487604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:26.608445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489010-d70e-44da-a505-0f072fc5ab69 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:26.646182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450854d-0889-4eb3-b71c-185677dc8170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:26.646961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450854d-0889-4eb3-b71c-185677dc8170 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:26.647248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450854d-0889-4eb3-b71c-185677dc8170 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:26.647528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450854d-0889-4eb3-b71c-185677dc8170 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:26.648750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450854d-0889-4eb3-b71c-185677dc8170 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:26.650378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450854d-0889-4eb3-b71c-185677dc8170 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:26.652523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 141/293] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:26 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:26.662760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:26.713302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:26.805589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74048c2c-128c-4091-b102-0e249fca42ef None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:26.846994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:26.847717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:26.848005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:26.848313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:26.849221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=97fcf1c7d48845b1b92a2fc7267567c3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:26.849564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:26.851043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1273-84cc-4cea-ae06-81e62d03274a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:26.858113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 153/294] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:26 2022] GET /identity/v3/role_assignments?user.id=97fcf1c7d48845b1b92a2fc7267567c3&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=e446eb256dc14055b69a04a154fdc373 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:27.370739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1f115-0caa-4630-9bfa-591663e94bd5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:27.371341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1f115-0caa-4630-9bfa-591663e94bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:27.371341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1f115-0caa-4630-9bfa-591663e94bd5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:27.372909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 142/295] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:27.379050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2d5be-cc15-4b15-a3fb-389dfffee449 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:27.380122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2d5be-cc15-4b15-a3fb-389dfffee449 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:27.380286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2d5be-cc15-4b15-a3fb-389dfffee449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:27.399813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c8a2d5be-cc15-4b15-a3fb-389dfffee449 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:27.401022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c8a2d5be-cc15-4b15-a3fb-389dfffee449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:27.491468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 154/296] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:27.517758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1f115-0caa-4630-9bfa-591663e94bd5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:27.521181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:27.629903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1f115-0caa-4630-9bfa-591663e94bd5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:27.667990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:27.669214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:27.669734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:27.670281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:27.684063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:27.684376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf974d8-1622-459f-9625-e641d5864ed2 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:27.684600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf974d8-1622-459f-9625-e641d5864ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:27.684891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf974d8-1622-459f-9625-e641d5864ed2 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:27.686616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 155/297] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:27.691438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:27.691765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:27.692050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:27.694025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:27.694889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:27.695759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:27.698486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 143/298] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:27.704667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:27.710471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:27.711762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:27.731368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:27.805449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 156/299] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:27.805702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:27.831940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:27.833484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611296-8d7d-4c14-bb5e-9e11433a5fde None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:27.870424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:27.871314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:27.871859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:27.872575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:27.874016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:27.874629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:27.877313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:27.893604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 144/300] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:27.897123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:27.963605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84421-c710-4148-bf87-e840c6e11773 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.004301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893ae1a-8275-4f3b-ab4c-8d0d887c56df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.005112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ae1a-8275-4f3b-ab4c-8d0d887c56df None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.005460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ae1a-8275-4f3b-ab4c-8d0d887c56df None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.005746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ae1a-8275-4f3b-ab4c-8d0d887c56df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.017809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893ae1a-8275-4f3b-ab4c-8d0d887c56df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:28.022010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7480-2f86-42d2-b908-2369af3071a8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5893ae1a-8275-4f3b-ab4c-8d0d887c56df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:28.026501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:28.027381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:28.028164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:28.032636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 157/301] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:28.034073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f3bcb-931c-447f-b06b-5815f05669ef None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.034269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f3bcb-931c-447f-b06b-5815f05669ef None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.034535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f3bcb-931c-447f-b06b-5815f05669ef None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.036551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 158/302] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:28.037196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f3bcb-931c-447f-b06b-5815f05669ef None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:28.050888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:28.051930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:28.064995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e2438-4770-4cdd-bb44-b67fbfe805b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.064995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e2438-4770-4cdd-bb44-b67fbfe805b5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.064995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e2438-4770-4cdd-bb44-b67fbfe805b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.064995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e2438-4770-4cdd-bb44-b67fbfe805b5 None admin] PATH_INFO: `/v3/users/82e22b23fb764bb0978e26dbcc006e1e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.066180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e2438-4770-4cdd-bb44-b67fbfe805b5 None admin] RBAC: Authorizing `identity:get_user(user_id=82e22b23fb764bb0978e26dbcc006e1e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.067845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e2438-4770-4cdd-bb44-b67fbfe805b5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.069563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 145/303] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:27 2022] GET /identity/v3/users/82e22b23fb764bb0978e26dbcc006e1e => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:28.069563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.069563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.069563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.088853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:28.090209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:28.168849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f3bcb-931c-447f-b06b-5815f05669ef None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.174067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 146/304] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:28.175055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:28.214041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.214708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.214997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.215274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.216021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:28.216333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.217744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.226860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 159/305] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:28.227659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:28.294125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5791-14f3-4c86-b881-abb2dc4022a2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.307004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:28.318913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:28.330370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.331308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.331605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.331888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] PATH_INFO: `/v3/system/users/82e22b23fb764bb0978e26dbcc006e1e/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.333960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=82e22b23fb764bb0978e26dbcc006e1e, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.335344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.339053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69bc6-47be-4254-b4b5-143c05508cdb None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.372167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.372955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.373272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.373586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.374762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.376204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.377880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 160/306] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:28.378643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:28.482143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799cac-05e1-4872-a263-073c9b8983e4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.483031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 147/307] 10.222.0.70 () {58 vars in 1334 bytes} [Tue Jun 21 16:28:28 2022] PUT /identity/v3/system/users/82e22b23fb764bb0978e26dbcc006e1e/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:28.484062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:28.523512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.524497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.524836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.525122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] PATH_INFO: `/v3/users/fa5a169ca2a14ae3ba09cbcae0497dad` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.541671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:28.543420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] RBAC: Authorizing `identity:get_user(user_id=fa5a169ca2a14ae3ba09cbcae0497dad)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.545190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.547472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 161/308] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:28 2022] GET /identity/v3/users/fa5a169ca2a14ae3ba09cbcae0497dad => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:28.554104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:28.608131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9db4-1755-4b3a-a02a-fcad83c69692 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.648598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304843b-5169-4702-b373-f500e76d38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.649550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304843b-5169-4702-b373-f500e76d38a4 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.650013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304843b-5169-4702-b373-f500e76d38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.650540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304843b-5169-4702-b373-f500e76d38a4 None admin] PATH_INFO: `/v3/groups` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.651443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304843b-5169-4702-b373-f500e76d38a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.653238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304843b-5169-4702-b373-f500e76d38a4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.678415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07d2d-e83a-419e-970d-8dca0893bb83 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:28.714626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:28.715284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.715568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.715906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.716770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] RBAC: Adding query filter params (role.id=4289c849c84d496592da62bc05d78f8d, user.id=fa5a169ca2a14ae3ba09cbcae0497dad, scope.system=all) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:28.717084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:28.718548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c141-b349-4652-b665-a2b79659c76e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:28.725126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 162/309] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Jun 21 16:28:28 2022] GET /identity/v3/role_assignments?user.id=fa5a169ca2a14ae3ba09cbcae0497dad&scope.system=all&role.id=4289c849c84d496592da62bc05d78f8d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:28.742347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 148/310] 10.222.0.70 () {60 vars in 1134 bytes} [Tue Jun 21 16:28:28 2022] POST /identity/v3/groups => generated 229 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:28.989996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a62cfd-6a08-44a4-964d-17081cdb29bb None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:28.990426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a62cfd-6a08-44a4-964d-17081cdb29bb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:28.990896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a62cfd-6a08-44a4-964d-17081cdb29bb None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:28.993255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 163/311] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:29.000274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:29.000572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:29.000861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:29.023483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:29.025018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:29.076961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:29.102768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 149/312] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:29.126322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a62cfd-6a08-44a4-964d-17081cdb29bb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:29.199730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:29.243617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a62cfd-6a08-44a4-964d-17081cdb29bb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:29.280806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:29.281662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:29.282173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:29.282508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:29.294780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:29.303770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:29.304776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:29.305604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 164/313] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:29.313255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:29.417703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3e83-5b70-4de2-9844-c910f2b3f2ab None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:29.454719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:29.455828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:29.456342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:29.456823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:29.457873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:29.458388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:29.459996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:29.469088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 150/314] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:29.475277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:29.578649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa5af4-dad8-4763-bcd5-e1663b235d84 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:29.602621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:29.613798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:29.614772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:29.618547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:29.618547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] PATH_INFO: `/v3/users/26e8e56e5ed14b2c8377be0d5a7186b2` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:29.618547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] RBAC: Authorizing `identity:get_user(user_id=26e8e56e5ed14b2c8377be0d5a7186b2)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:29.618547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:29.620296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 165/315] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:29 2022] GET /identity/v3/users/26e8e56e5ed14b2c8377be0d5a7186b2 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:29.625792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:29.673673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:29.737304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbaea5-1b67-4435-a0a5-f766e411a853 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:29.773158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:29.774056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:29.774522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:29.774953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:29.845157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:29.847331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:29.888190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:29.953420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 151/316] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:29.959295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:30.068422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badd32-886d-473d-8d28-0fa4e0199d1b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:30.103575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987c6ac-a341-4dd7-8738-fa7c0e11cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:30.104763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c6ac-a341-4dd7-8738-fa7c0e11cf0d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.105247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c6ac-a341-4dd7-8738-fa7c0e11cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.105747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c6ac-a341-4dd7-8738-fa7c0e11cf0d None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.107128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987c6ac-a341-4dd7-8738-fa7c0e11cf0d None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:30.108779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987c6ac-a341-4dd7-8738-fa7c0e11cf0d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:30.111174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 166/317] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:29 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:30.117776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:30.222835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d78b4-06f1-4dce-890e-f2b174c7b189 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:30.262588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:30.263247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.263529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.263808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.264640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] RBAC: Adding query filter params (role.id=4289c849c84d496592da62bc05d78f8d, scope.project.id=5cad7076bb634184b26c7fbcf79495a5, user.id=26e8e56e5ed14b2c8377be0d5a7186b2) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:30.264953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:30.266835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efba832-62d9-4f59-af66-e3663b47e331 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:30.277223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 152/318] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:30 2022] GET /identity/v3/role_assignments?user.id=26e8e56e5ed14b2c8377be0d5a7186b2&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=4289c849c84d496592da62bc05d78f8d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:30.644524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2fbf-b452-44c3-925c-e994130c620f None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.645653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2fbf-b452-44c3-925c-e994130c620f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.645922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2fbf-b452-44c3-925c-e994130c620f None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.647266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 167/319] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:30.652803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6666-a726-4117-b446-5be388e3ba46 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.653268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6666-a726-4117-b446-5be388e3ba46 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.653384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6666-a726-4117-b446-5be388e3ba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.658635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:30.670835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bbdc6666-a726-4117-b446-5be388e3ba46 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:30.672032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bbdc6666-a726-4117-b446-5be388e3ba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:30.742028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 153/320] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:30.765850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2fbf-b452-44c3-925c-e994130c620f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:30.828321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:30.874251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2fbf-b452-44c3-925c-e994130c620f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:30.902539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d7b8-88a7-4666-ba0e-4a143b56ebee None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.902784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d7b8-88a7-4666-ba0e-4a143b56ebee None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.903186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d7b8-88a7-4666-ba0e-4a143b56ebee None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.904661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 154/321] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:30.908907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:30.909669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521ac72-66f8-4cb7-bbde-634a9b4edca2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.909955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:30.910069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521ac72-66f8-4cb7-bbde-634a9b4edca2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.910297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:30.910899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521ac72-66f8-4cb7-bbde-634a9b4edca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.911072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:30.922232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:30.928103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9521ac72-66f8-4cb7-bbde-634a9b4edca2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:30.929291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9521ac72-66f8-4cb7-bbde-634a9b4edca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:30.930345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:30.931302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:30.932444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 168/322] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:30.937080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.009628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 155/323] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:31.014929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dec6d-6d77-4d82-bb1e-7eaf8a06ff47 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.015293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dec6d-6d77-4d82-bb1e-7eaf8a06ff47 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.015572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dec6d-6d77-4d82-bb1e-7eaf8a06ff47 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.017150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 156/324] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:31.023586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.023872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.024154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.041757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:31.042950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:31.055078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fd16c-81a7-443a-8621-b6e3a064a7ce None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.071610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:31.089100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.089799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.090091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.090375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.091251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:31.091563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.092968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.099586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:31.102195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 169/325] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:31.103125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.109615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 157/326] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:31.110420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.212969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9f572-2ebf-4402-baa6-bc2a63cdf405 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.213755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f8570-47c1-40d4-88d4-c06f50c1de1d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.246194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.246854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.246980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.247280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.247557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.247728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.248015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.248294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] PATH_INFO: `/v3/users/82e22b23fb764bb0978e26dbcc006e1e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.249499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] RBAC: Authorizing `identity:get_user(user_id=82e22b23fb764bb0978e26dbcc006e1e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.250971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.252623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 158/327] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:31 2022] GET /identity/v3/users/82e22b23fb764bb0978e26dbcc006e1e => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:31.253400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.258693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:31.266469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:31.267346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:31.268131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 170/328] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:31.268781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.315816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:31.316319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:31.388877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f834-21a7-416f-ae73-b5fee67aca99 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.389513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937ee9-b00c-4d49-ad62-287964c62286 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.422303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.422954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.423234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.423510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.424337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] RBAC: Adding query filter params (role.id=e446eb256dc14055b69a04a154fdc373, user.id=82e22b23fb764bb0978e26dbcc006e1e, scope.system=all) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:31.424443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.424650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.425128 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.425449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.425732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.426707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.427157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.428631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.430324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 159/329] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:31.435589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.438599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 171/330] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Jun 21 16:28:31 2022] GET /identity/v3/role_assignments?user.id=82e22b23fb764bb0978e26dbcc006e1e&scope.system=all&role.id=e446eb256dc14055b69a04a154fdc373 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:31.439303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.555613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374755-1080-46ce-b292-334b5beaa9e6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.556882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:31.562064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e1eb-ade0-491f-8723-73f44bf33334 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.586293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:31.594484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.594946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.595490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.595859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.596515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:31.596822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.598880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.604413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.605091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.605411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.606151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] PATH_INFO: `/v3/groups` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.606400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.607549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 160/331] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:31.608170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.613182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.711606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 172/332] 10.222.0.70 () {60 vars in 1134 bytes} [Tue Jun 21 16:28:31 2022] POST /identity/v3/groups => generated 226 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:31.714685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1a6f3-916b-4008-b358-460b2d89440f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.753957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db7214-4cb9-45ca-a915-26d3c0017249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.755493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db7214-4cb9-45ca-a915-26d3c0017249 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.755781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db7214-4cb9-45ca-a915-26d3c0017249 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.756058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db7214-4cb9-45ca-a915-26d3c0017249 None admin] PATH_INFO: `/v3/users/fa5a169ca2a14ae3ba09cbcae0497dad` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.757380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db7214-4cb9-45ca-a915-26d3c0017249 None admin] RBAC: Authorizing `identity:get_user(user_id=fa5a169ca2a14ae3ba09cbcae0497dad)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.758891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db7214-4cb9-45ca-a915-26d3c0017249 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.760644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 161/333] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:31 2022] GET /identity/v3/users/fa5a169ca2a14ae3ba09cbcae0497dad => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:31.766693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:31.872847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd255e5-600c-4a03-9fca-51525d6b420f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:31.907235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45173206-6d3f-40a0-9504-cc6abad2b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:31.908098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45173206-6d3f-40a0-9504-cc6abad2b71c None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:31.908395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45173206-6d3f-40a0-9504-cc6abad2b71c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:31.908673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45173206-6d3f-40a0-9504-cc6abad2b71c None admin] PATH_INFO: `/v3/system/users/fa5a169ca2a14ae3ba09cbcae0497dad/roles/4289c849c84d496592da62bc05d78f8d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:31.911171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45173206-6d3f-40a0-9504-cc6abad2b71c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa5a169ca2a14ae3ba09cbcae0497dad, role_id=4289c849c84d496592da62bc05d78f8d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:31.912657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45173206-6d3f-40a0-9504-cc6abad2b71c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:31.984634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 173/334] 10.222.0.70 () {58 vars in 1334 bytes} [Tue Jun 21 16:28:31 2022] PUT /identity/v3/system/users/fa5a169ca2a14ae3ba09cbcae0497dad/roles/4289c849c84d496592da62bc05d78f8d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:34.260349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307f618-e4cb-4184-b380-a4076bfcd0fd None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.260858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307f618-e4cb-4184-b380-a4076bfcd0fd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.260934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307f618-e4cb-4184-b380-a4076bfcd0fd None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.262506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 162/335] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:34.268773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.269734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.270229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.297965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:34.308989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:34.326460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:34.394353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 174/336] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:34.431057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307f618-e4cb-4184-b380-a4076bfcd0fd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:34.512973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:34.562052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307f618-e4cb-4184-b380-a4076bfcd0fd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:34.615668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519705f-bd3f-41c0-8fee-8db6d15a57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:34.616499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519705f-bd3f-41c0-8fee-8db6d15a57f7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.616784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519705f-bd3f-41c0-8fee-8db6d15a57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.617064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519705f-bd3f-41c0-8fee-8db6d15a57f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.635949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519705f-bd3f-41c0-8fee-8db6d15a57f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0519705f-bd3f-41c0-8fee-8db6d15a57f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:34.644296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:34.645192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:34.646454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 163/337] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:34.651438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:34.681195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c8b8-95ac-453f-a0c4-d2e82f69ec8f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.681582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c8b8-95ac-453f-a0c4-d2e82f69ec8f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.681787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c8b8-95ac-453f-a0c4-d2e82f69ec8f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.683468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 164/338] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:34.689363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.689657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.689947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.714358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:34.715590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:34.810063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 165/339] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:34.844418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f8f4-f412-495a-8572-7f465704168e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:34.858519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:34.927291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:34.927967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.928254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.928532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.929304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:34.929626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:34.931030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ab389-773e-492e-aa74-9559c495aebf None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:34.951827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 175/340] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:34.953138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632c39-462a-4003-a8a8-cefad207923b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:34.953456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632c39-462a-4003-a8a8-cefad207923b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:34.953740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632c39-462a-4003-a8a8-cefad207923b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:34.959389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:34.964074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 176/341] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:34.964950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c632c39-462a-4003-a8a8-cefad207923b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:35.002345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:35.057630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa6095-699d-484e-9d23-46831302c2d0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:35.130965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb82d1b-4e86-4943-a171-e8571f9c6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:35.131695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82d1b-4e86-4943-a171-e8571f9c6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.131983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82d1b-4e86-4943-a171-e8571f9c6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.132261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb82d1b-4e86-4943-a171-e8571f9c6fe0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.154342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb82d1b-4e86-4943-a171-e8571f9c6fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:35.162130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c632c39-462a-4003-a8a8-cefad207923b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-deb82d1b-4e86-4943-a171-e8571f9c6fe0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:35.163285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:35.164139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:35.164915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:35.171867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 166/342] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:35.173444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3167-2e0f-4317-ad35-416527fa6b80 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.173959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3167-2e0f-4317-ad35-416527fa6b80 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.174448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3167-2e0f-4317-ad35-416527fa6b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.207421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-db7c3167-2e0f-4317-ad35-416527fa6b80 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:35.208949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-db7c3167-2e0f-4317-ad35-416527fa6b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:35.211349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543abc-3500-42d9-89c2-dc78fd2fe096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:35.212964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543abc-3500-42d9-89c2-dc78fd2fe096 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.213269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543abc-3500-42d9-89c2-dc78fd2fe096 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.213612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543abc-3500-42d9-89c2-dc78fd2fe096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.318493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 167/343] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:35.320289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f9cf8-833b-4ccc-9923-fd87cd34b44a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.320595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f9cf8-833b-4ccc-9923-fd87cd34b44a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.320872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f9cf8-833b-4ccc-9923-fd87cd34b44a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.322895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 168/344] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:35.323606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f9cf8-833b-4ccc-9923-fd87cd34b44a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:35.331798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d543abc-3500-42d9-89c2-dc78fd2fe096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:35.333345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d543abc-3500-42d9-89c2-dc78fd2fe096 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:35.351521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:35.380590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:35.449158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f9cf8-833b-4ccc-9923-fd87cd34b44a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:35.470293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 177/345] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:35.474330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463972e0-3d03-4cf3-9e9a-8b218e7c57b1 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.474699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463972e0-3d03-4cf3-9e9a-8b218e7c57b1 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.474992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463972e0-3d03-4cf3-9e9a-8b218e7c57b1 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.479725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 178/346] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:35.479725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.479725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.479725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.493983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:35.494817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.495112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.495387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.496156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:35.497556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:35.499177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:35.499656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:35.500843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:35.513547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 169/347] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:35.513547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:35.584592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 179/348] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:35.586566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:35.654800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:35.663863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:35.667323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703b82-a23b-400e-9922-60d7dfec31a1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:35.709952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112856b6-93be-4de4-ac82-97c76ca6584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:35.711428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112856b6-93be-4de4-ac82-97c76ca6584f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.712037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112856b6-93be-4de4-ac82-97c76ca6584f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.712516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112856b6-93be-4de4-ac82-97c76ca6584f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.724128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ca7b-3dd4-4474-83d6-5e9bfdecf55c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:35.727966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112856b6-93be-4de4-ac82-97c76ca6584f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-112856b6-93be-4de4-ac82-97c76ca6584f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:35.738009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:35.739309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:35.740113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 170/349] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:35.741238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.741393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.741678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.763698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:35.765038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:35.777190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:35.778433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.779013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.779303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.780680 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:35.784225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:35.787911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 180/350] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:35 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:35.788307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:35.858780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 171/351] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:35.860173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:35.933035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e706e71-2fc6-47a9-a65f-529e17e471f2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:35.949542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:35.981381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:35.982266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:35.982877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:35.983319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:35.983446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.005178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157c2ce-510b-4ddb-a51b-bcf0d6524950 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.059704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.060532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.060818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.061095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.067383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.068865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.074991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:36.085918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:36.086871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:36.087658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:36.088247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 172/352] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:36.089352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.206357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 181/353] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:36.207622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.227058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.236803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59af21-f8f9-454c-88da-0055413e757f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.287677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.288475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.288804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.289094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.289887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:36.290200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.292110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.302715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 173/354] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:36.307509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.324169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.350277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3644d7-f8ec-447a-b411-2012c7b25f7a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.392775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.393671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.393966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.394788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.402950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.404404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.406185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 182/355] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:36.406982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.428786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017b7b5-0dd2-41b9-91fc-ed07d2b93e80 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.474657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.475473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.475761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.477311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.488448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:36.497190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:36.498212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 16:28:36.499022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:36.499704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.499777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 174/356] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:36.499777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.530965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236db502-eef3-4d9b-9054-efbab03e9a85 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.578472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.579157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.579454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.579777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.580548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:36.580864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.582321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.584042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.591965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 183/357] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:36.597722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.622055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce161b6b-ac46-4215-911c-2236eed33e4c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.662945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625447a-0827-40bc-8183-d6a7e7cbfcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.663819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625447a-0827-40bc-8183-d6a7e7cbfcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.664768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625447a-0827-40bc-8183-d6a7e7cbfcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.664768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625447a-0827-40bc-8183-d6a7e7cbfcb2 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.665820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625447a-0827-40bc-8183-d6a7e7cbfcb2 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.667334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625447a-0827-40bc-8183-d6a7e7cbfcb2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.673690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 175/358] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:36.673690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93198-d5b5-4c45-9cd2-e88af6ed7e23 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.673690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93198-d5b5-4c45-9cd2-e88af6ed7e23 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.673690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93198-d5b5-4c45-9cd2-e88af6ed7e23 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.673690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 176/359] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:36.673690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93198-d5b5-4c45-9cd2-e88af6ed7e23 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.727879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ee44-2f8a-4b70-854a-5bdb0b01b262 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.770636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.771360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.771680 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.771934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.781602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.796865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93198-d5b5-4c45-9cd2-e88af6ed7e23 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:36.836346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:36.837249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:36.837744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:36.838186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:36.839030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=f2925804921b45939d514246d9ae2dac) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:36.839354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.840809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.847034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 177/360] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=3ad4a86440e943caac11daabeeb44957 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:36.848113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:36.852677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:36.856511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:36.858119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:36.987538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39b285-c6bf-4aef-ad07-ce75782e0749 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.013041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 184/361] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:37.014293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.042629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.043537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.043828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.044112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.044874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:37.045192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.047133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.056683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 178/362] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.057700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.083678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.145064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.154130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d707-108b-4dc4-855a-8e8f862c7f12 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.182100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f2490-1ae5-4791-9fbc-dde0abcc8c87 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.192248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.193421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.193903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.194360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.215747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25661d-c36f-4e95-9f5f-083a43d95838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.216611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25661d-c36f-4e95-9f5f-083a43d95838 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.216900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25661d-c36f-4e95-9f5f-083a43d95838 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.217179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25661d-c36f-4e95-9f5f-083a43d95838 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.218390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25661d-c36f-4e95-9f5f-083a43d95838 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.220169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25661d-c36f-4e95-9f5f-083a43d95838 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.221854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 179/363] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.224000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.224290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.224574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.243183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:37.244391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:37.279386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.280855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.325383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 180/364] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:37.325383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.325982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.391530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 185/365] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:37.393237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.407733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.453224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d1c8a-fc60-4fd3-a2fa-f32696a9c50f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.489423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.490590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.490874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.491155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.492464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.493979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.495714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 181/366] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.496474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.516993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b77b-f438-44c2-8f62-8694199047f9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.554560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.555593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.555924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.556484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] PATH_INFO: `/v3/users/fa5a169ca2a14ae3ba09cbcae0497dad` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.557568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] RBAC: Authorizing `identity:get_user(user_id=fa5a169ca2a14ae3ba09cbcae0497dad)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.559285 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.565778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 186/367] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/users/fa5a169ca2a14ae3ba09cbcae0497dad => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.565778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.578006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.608834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965c3df-ea55-4a5b-b0b0-411c638694e4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.643476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.648487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.648902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.649185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.649495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.650606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=f2925804921b45939d514246d9ae2dac) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:37.650606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.653518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.657616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 182/368] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=e446eb256dc14055b69a04a154fdc373 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.658225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.686954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c057b-481f-4ec2-bba4-91151983b6dd None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.729828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.730717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.731005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.731280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.745214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:37.753111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:37.754944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:37.755752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:37.757331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 187/369] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:37.761600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.808006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477cc5-8e84-4633-86fc-185de64db2be None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.847367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.854429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.855554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.856171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.863970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.863970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.863970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.863970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 183/370] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.863970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:37.901966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a91243-8981-47aa-8428-dd3803cd5a29 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:37.949723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:37.954430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:37.955431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:37.955824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:37.956175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:37.958136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:37.959708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:37.961811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 188/371] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:37.963120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:38.011031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da6c43-be20-4a74-accc-b5e66c73fac7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:38.062336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:38.063418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:38.063806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:38.064210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:38.065842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] RBAC: Adding query filter params (role.id=4289c849c84d496592da62bc05d78f8d, user.id=fa5a169ca2a14ae3ba09cbcae0497dad, scope.system=all) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:38.067046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:38.069110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:38.086866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac26fbe-9fc7-4b37-b5ba-a6d2e84db250 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:38.089365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 184/372] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/role_assignments?user.id=fa5a169ca2a14ae3ba09cbcae0497dad&scope.system=all&role.id=4289c849c84d496592da62bc05d78f8d => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:38.090438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:38.151052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:38.151992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:38.152429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:38.152864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:38.153893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:38.154445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:38.156297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:38.168785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 189/373] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:38.169317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:38.173189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:38.322655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517a1f-9897-4d9c-9a75-ce54f836a06b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:38.348542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0c6c5-f575-4d9d-967f-fee03ce18f31 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:38.360334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:38.375236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:38.375236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:38.375236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:38.375236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:38.375807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:38.375807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:38.384954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 185/374] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:38 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:38.384954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:38.417566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:38.417566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:38.417566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:38.417566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:38.418364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=5cad7076bb634184b26c7fbcf79495a5) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:38.418732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:38.420750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:38.433082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 190/375] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:38 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=e446eb256dc14055b69a04a154fdc373 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:38.434237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:38.549911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef97d25-75ba-4efd-9aa8-f21426ddcdb0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:38.595261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:38.607623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:38.608679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:38.609114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:38.609957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:38.694389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:38.705995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:38.708933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:38.709935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af93f3-a8a6-491e-b255-4073d540e2a7 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:38.773321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:38.775193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:38.775483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:38.775766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:38.776629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=5cad7076bb634184b26c7fbcf79495a5) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:38.776951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:38.778445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:38.792173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 191/376] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:38 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=3ad4a86440e943caac11daabeeb44957 => generated 260 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:38.858099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 186/377] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:38.863544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:39.017661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02998-7f8d-4a31-b281-c40de67e36d8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:39.060162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:39.075402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:39.076808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:39.077098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:39.078689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] PATH_INFO: `/v3/projects/5b5dc23437bc45dfae144cb9e387649c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:39.078809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5dc23437bc45dfae144cb9e387649c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:39.080517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:39.082964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 192/378] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:38 2022] GET /identity/v3/projects/5b5dc23437bc45dfae144cb9e387649c => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:39.090147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:39.212353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:39.224765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628112d-e3ec-40d0-8978-438e41a9b9c0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:39.273069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655b452-cfb1-4351-acb2-1db056944b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:39.273907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b452-cfb1-4351-acb2-1db056944b60 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:39.274197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b452-cfb1-4351-acb2-1db056944b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:39.274478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655b452-cfb1-4351-acb2-1db056944b60 None admin] PATH_INFO: `/v3/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:39.283259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655b452-cfb1-4351-acb2-1db056944b60 None admin] RBAC: Authorizing `identity:get_group(group_id=5e3673f616ef4da2a0e7dd3e0ffab2ac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:39.285427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655b452-cfb1-4351-acb2-1db056944b60 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:39.287751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 187/379] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:39 2022] GET /identity/v3/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:39.293964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:39.334111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc15c6-8ea0-4ab6-9a06-7115dc65469a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:39.334563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc15c6-8ea0-4ab6-9a06-7115dc65469a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:39.334983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc15c6-8ea0-4ab6-9a06-7115dc65469a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:39.337400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 188/380] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:39.343737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:39.344694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:39.346039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:39.383204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:39.384501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:39.476586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72b2b-e782-412d-81c2-d8f96cdbc4b6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:39.523467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 189/381] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:39.543864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:39.554088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:39.554764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:39.555193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:39.559244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:39.560938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] RBAC: Adding query filter params (group.id=5e3673f616ef4da2a0e7dd3e0ffab2ac, role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=5b5dc23437bc45dfae144cb9e387649c) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:39.561262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:39.562753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:39.583117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 193/382] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:39 2022] GET /identity/v3/role_assignments?group.id=5e3673f616ef4da2a0e7dd3e0ffab2ac&scope.project.id=5b5dc23437bc45dfae144cb9e387649c&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:39.682585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:39.705561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241080fb-a84b-4a0d-98c8-8552be57e143 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:39.760200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:39.761034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:39.761346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:39.761627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:39.778490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:39.787400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:39.788301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:39.789092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:39.791871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 190/383] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:39.797965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:39.902343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:39.966992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71330ae-94e5-44b7-a671-e9b0fedd904b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:40.031557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:40.032151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.032437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.032715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.033500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:40.033810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:40.036770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:40.049438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 194/384] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:40.055131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:40.210183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58694df7-a3d7-48aa-b4d8-f38cc478f5f7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:40.266402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872718-089f-40e0-adee-d09c74d84040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:40.267420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872718-089f-40e0-adee-d09c74d84040 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.267588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872718-089f-40e0-adee-d09c74d84040 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.267850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872718-089f-40e0-adee-d09c74d84040 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.274148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85872718-089f-40e0-adee-d09c74d84040 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:40.275665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85872718-089f-40e0-adee-d09c74d84040 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:40.277777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 191/385] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:40 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:40.283277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:40.320820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a652741-1f0a-449c-9ee2-cc77aab9f6d2 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.321236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a652741-1f0a-449c-9ee2-cc77aab9f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.321490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a652741-1f0a-449c-9ee2-cc77aab9f6d2 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.323057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 192/386] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:40.332574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.332574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.332574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.350959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:40.352456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:40.361732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:40.457913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 193/387] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:40.484529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:40.491844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ea3c-d9c5-455c-9bdf-682f9fd68058 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:40.528230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:40.580155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:40.583069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.583584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.584472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.586320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:40.588963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:40.594035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 195/388] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:40 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:40.599331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:40.659121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78385288-8aee-4a59-9213-cbd7ff7efde8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:40.728792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:40.729976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.731122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.731614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.759964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:40.779837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:40.780778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:40.781592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:40.794168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 194/389] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:40.802957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb404f-9b92-47c3-b31f-026afdb61ffa None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:40.806286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:40.812722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:40.841354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a5e29-fdf4-4f8c-897f-f5bb189b875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:40.842758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5e29-fdf4-4f8c-897f-f5bb189b875a None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.843255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5e29-fdf4-4f8c-897f-f5bb189b875a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.843720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5e29-fdf4-4f8c-897f-f5bb189b875a None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac/groups/a5252d37f38b40448ac9f946fea51ed4/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.846583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a5e29-fdf4-4f8c-897f-f5bb189b875a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2925804921b45939d514246d9ae2dac, group_id=a5252d37f38b40448ac9f946fea51ed4, role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:40.848858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a5e29-fdf4-4f8c-897f-f5bb189b875a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:40.948832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 196/390] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Jun 21 16:28:40 2022] PUT /identity/v3/projects/f2925804921b45939d514246d9ae2dac/groups/a5252d37f38b40448ac9f946fea51ed4/roles/3ad4a86440e943caac11daabeeb44957 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:40.963038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d1fb-43ad-43a8-a7e3-0653e0083930 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:40.990277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a491e08-af12-48d4-8f67-f87ceb0c2e45 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.990635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a491e08-af12-48d4-8f67-f87ceb0c2e45 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.990865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a491e08-af12-48d4-8f67-f87ceb0c2e45 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:40.992842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 197/391] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:40.998654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:40.998971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:40.999223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.010011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.011056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.011626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.012095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.013129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:41.013660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:41.015300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:41.028114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 195/392] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:41.034026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.041190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:41.042450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:41.133255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:41.166987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:41.174761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 198/393] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:41.209609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.216409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbd66f-e434-4ba4-95b8-6a165dd18a37 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:41.264139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.265021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.265751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.266173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.267594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:41.269726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:41.272149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 196/394] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:41.283020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.332756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4137d80-9e86-4236-ba98-99edfa54b61e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:41.373110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.374310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.374824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.375262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.389449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:41.398563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:41.399498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:41.400281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:41.403067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 199/395] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:41.414318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.425780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c01fc-2558-4e68-94a4-2bec87113a73 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:41.460672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:41.473031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.474428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.474877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.476646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.478746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:41.480217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:41.482187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 197/396] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:41.490249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.512465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:41.606604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b0896-3d6c-4c49-9d12-28e942d6b3b4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:41.626957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df13915-e9e6-43a6-8cb3-b43bbd1a8e13 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:41.660626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d08f95-85d7-41b6-8097-2bcd370a365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.664440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d08f95-85d7-41b6-8097-2bcd370a365f None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.664924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d08f95-85d7-41b6-8097-2bcd370a365f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.665478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d08f95-85d7-41b6-8097-2bcd370a365f None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac/groups/a5252d37f38b40448ac9f946fea51ed4/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.668513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.669114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d08f95-85d7-41b6-8097-2bcd370a365f None admin] RBAC: Authorizing `identity:create_grant(project_id=f2925804921b45939d514246d9ae2dac, group_id=a5252d37f38b40448ac9f946fea51ed4, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:41.669627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.670110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.670563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.670665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d08f95-85d7-41b6-8097-2bcd370a365f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:41.671576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:41.672073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:41.673647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeb543-b41a-4737-9fdc-7afb0fadd6bb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:41.684203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 200/397] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:41.685862 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130349-9939-43cd-b050-e2e0976469cb None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.686336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130349-9939-43cd-b050-e2e0976469cb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.686778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130349-9939-43cd-b050-e2e0976469cb None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.688438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 201/398] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:41.693564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130349-9939-43cd-b050-e2e0976469cb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.765988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 198/399] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Jun 21 16:28:41 2022] PUT /identity/v3/projects/f2925804921b45939d514246d9ae2dac/groups/a5252d37f38b40448ac9f946fea51ed4/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:41.768073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.768594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.769246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.812202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:41.813858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:41.861983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:41.870650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130349-9939-43cd-b050-e2e0976469cb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:41.897185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:41.922305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 199/400] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:41.933774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:41.934733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:41.935126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:41.935532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:41.936836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:41.938488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:41.940701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 202/401] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:41.947262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:41.965425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.115062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222c6c4-fc4c-48c2-996d-749addbafeac None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.118152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc3f8-15a2-4625-8a37-d7f0b41e9496 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.165191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17274c68-794a-44f9-b4f8-b8d1ba7e8922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.166802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274c68-794a-44f9-b4f8-b8d1ba7e8922 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.167374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274c68-794a-44f9-b4f8-b8d1ba7e8922 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.167844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17274c68-794a-44f9-b4f8-b8d1ba7e8922 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.168290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb9d2-90a0-4b59-b0c6-4a8343078b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.169205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb9d2-90a0-4b59-b0c6-4a8343078b3a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.169595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb9d2-90a0-4b59-b0c6-4a8343078b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.170033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb9d2-90a0-4b59-b0c6-4a8343078b3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.170551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17274c68-794a-44f9-b4f8-b8d1ba7e8922 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:42.172612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17274c68-794a-44f9-b4f8-b8d1ba7e8922 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:42.174666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 200/402] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:42.176258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ca2e-0341-40aa-adcf-16a33b07e350 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.176841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ca2e-0341-40aa-adcf-16a33b07e350 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.177378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ca2e-0341-40aa-adcf-16a33b07e350 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.179250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 201/403] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:42.180783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ca2e-0341-40aa-adcf-16a33b07e350 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.189873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eb9d2-90a0-4b59-b0c6-4a8343078b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-346eb9d2-90a0-4b59-b0c6-4a8343078b3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:42.201630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:42.202751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:42.203542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 203/404] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:42.204778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.204778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.205046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.231242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:42.232482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:42.261335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:42.271805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:42.313494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ca2e-0341-40aa-adcf-16a33b07e350 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.337701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 204/405] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:42.342183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.384992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.387078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.387568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.388272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5/groups/a5252d37f38b40448ac9f946fea51ed4/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.391445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] RBAC: Authorizing `identity:create_grant(project_id=5cad7076bb634184b26c7fbcf79495a5, group_id=a5252d37f38b40448ac9f946fea51ed4, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:42.394543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:42.481651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9565e-02a1-41a6-b653-56c96911c970 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.493564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 202/406] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Jun 21 16:28:42 2022] PUT /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5/groups/a5252d37f38b40448ac9f946fea51ed4/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:28:42.495087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.555800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.556530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.556826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.557114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.557958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:42.558279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:42.559754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:42.579886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 205/407] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:42.586033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.631059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:42.641271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0cf4d-b6c7-4f8a-8bd5-10dbc367722d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.665455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:42.690364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.693994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.695367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.695857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.715334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:42.727201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:42.728904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:42.730513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:42.733511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 203/408] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:42.743803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.815105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb489d8-301d-4eb2-a23b-47281118acd9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.872658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.874403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.875163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.875636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.877476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:42.880014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:42.882497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 206/409] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:42 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:42.888868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:42.889574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e68eb-3957-4fbd-8c53-7f4ac0b5ea8c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:42.952310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:42.953043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:42.953587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:42.953877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:42.956477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:42.956978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:42.960645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:42.982467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 204/410] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:42.990308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:43.054435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:43.068703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bf1b7-a4e1-4c2f-ba23-208fd6e5bc82 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:43.079283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:43.123865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:43.124920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.125478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.125972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.127554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:43.129953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:43.132350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 207/411] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:42 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:43.140404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:43.208744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a8216-e34b-4b1c-a06f-aa5c6256b7ba None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:43.281862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:43.282729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.283016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.283295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] PATH_INFO: `/v3/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.285147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] RBAC: Authorizing `identity:get_group(group_id=5e3673f616ef4da2a0e7dd3e0ffab2ac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:43.286833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:43.289030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 205/412] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:42 2022] GET /identity/v3/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac => generated 229 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:43.295710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:43.358029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687ff4-9b2c-4a14-942d-4d64324b1d7c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:43.428325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:43.429600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.430755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.431795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5/groups/a5252d37f38b40448ac9f946fea51ed4/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.436981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] RBAC: Authorizing `identity:create_grant(project_id=5cad7076bb634184b26c7fbcf79495a5, group_id=a5252d37f38b40448ac9f946fea51ed4, role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:43.438471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:43.471590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce5478-37c5-4f1b-ba66-ef0e9112581b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:43.482032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:43.509625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289386f-3d2a-4831-81aa-0b783c1dac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:43.510726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289386f-3d2a-4831-81aa-0b783c1dac0f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.510917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289386f-3d2a-4831-81aa-0b783c1dac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.511166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289386f-3d2a-4831-81aa-0b783c1dac0f None admin] PATH_INFO: `/v3/projects/5b5dc23437bc45dfae144cb9e387649c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.512409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289386f-3d2a-4831-81aa-0b783c1dac0f None admin] RBAC: Authorizing `identity:get_project(project_id=5b5dc23437bc45dfae144cb9e387649c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:43.512621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 208/413] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Jun 21 16:28:43 2022] PUT /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5/groups/a5252d37f38b40448ac9f946fea51ed4/roles/3ad4a86440e943caac11daabeeb44957 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:43.525031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289386f-3d2a-4831-81aa-0b783c1dac0f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:43.525031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 206/414] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:43 2022] GET /identity/v3/projects/5b5dc23437bc45dfae144cb9e387649c => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:43.525031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb754dce-567c-4b5b-93bd-24bc6c295974 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.525031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb754dce-567c-4b5b-93bd-24bc6c295974 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.525031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb754dce-567c-4b5b-93bd-24bc6c295974 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.525031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 207/415] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:43.525689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:43.525768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.525768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.525768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.556447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:43.556447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:43.562906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:43.712921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 208/416] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:43.735428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:43.750125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451a3d-5350-45b1-8607-388b6260c32e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:43.804469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:43.805352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.805638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.805914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] PATH_INFO: `/v3/projects/5b5dc23437bc45dfae144cb9e387649c/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.809880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5dc23437bc45dfae144cb9e387649c, group_id=5e3673f616ef4da2a0e7dd3e0ffab2ac, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:43.813333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:43.867705 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df67ac2-08dd-4d84-9068-aabe9b02fbcb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:43.881083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:43.883919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 209/417] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Jun 21 16:28:43 2022] PUT /identity/v3/projects/5b5dc23437bc45dfae144cb9e387649c/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:28:43.922940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:43.923837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:43.924164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:43.924448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:43.946149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:43.954678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:43.955749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:43.956576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 209/418] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:43.963731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:44.069591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:44.103491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c1fb4-4d70-4991-b53e-8c5f2eb42507 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:44.142679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:44.143354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:44.144304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:44.145231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:44.146028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:44.146341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:44.147801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414acb17-f5ef-4bf3-905e-d0478f2edf78 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:44.157851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 210/419] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:44.163496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:44.276458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d59d-82ad-47f8-8b7c-74d52f07260c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:44.312147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:44.312807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:44.313092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:44.313406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:44.318603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb451696-a1b6-4b06-88c5-64850cbe2a02 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:44.318890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb451696-a1b6-4b06-88c5-64850cbe2a02 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:44.319170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb451696-a1b6-4b06-88c5-64850cbe2a02 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:44.323533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 211/420] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:44.330822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:44.331421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:44.331984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:44.360627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:44.363803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:44.383313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:44.449381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:44.450857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:44.491016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 212/421] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:44.546453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:44.614597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 210/422] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:44.621198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:44.701043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:44.782438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72871bd1-b1df-434a-af8d-59e135752ce2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:44.790387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:44.853850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:44.855436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:44.856132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:44.856815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:44.876109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:44.896412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:44.898112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:44.899634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:44.903069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 213/423] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:44.908749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e58c1-1086-4215-81ea-3ae011355665 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:44.914344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:44.980207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:44.981085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:44.981387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:44.981664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:44.982919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:44.984375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:44.987876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 211/424] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:44 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:44.993620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.103716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca9ad-9447-4297-9fe5-9e88aaff8ddf None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.138498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:45.149336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:45.150730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.151293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.151869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.153306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] RBAC: Adding query filter params (name=member) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:45.153954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:45.156633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acced160-d6d3-443a-b188-6791f47d467a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:45.163830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70f1c-0a0b-44e6-bced-549884947011 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.171567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 214/425] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:45.177839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120e79f-e367-4fa4-8d3b-4baf1cba9724 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.178822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120e79f-e367-4fa4-8d3b-4baf1cba9724 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.179314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120e79f-e367-4fa4-8d3b-4baf1cba9724 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.181216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 215/426] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:45.182181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120e79f-e367-4fa4-8d3b-4baf1cba9724 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.208379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81147a3-8101-4147-b4bd-257e17ba8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:45.209266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81147a3-8101-4147-b4bd-257e17ba8f02 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.209588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81147a3-8101-4147-b4bd-257e17ba8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.209922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81147a3-8101-4147-b4bd-257e17ba8f02 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.211308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81147a3-8101-4147-b4bd-257e17ba8f02 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:45.212765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81147a3-8101-4147-b4bd-257e17ba8f02 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:45.215205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 212/427] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:44 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:45.220272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.220272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.220272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.226732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:45.239415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:45.240813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:45.311984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120e79f-e367-4fa4-8d3b-4baf1cba9724 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.318502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 213/428] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:45.323492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.354558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:45.355625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.356096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.356605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.431946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:45.448556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:45.450288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:45.495589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3727d1-9005-420c-8038-c5604b8dd171 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.537816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:45.543524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:45.544770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.545249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.545658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.546618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=f2925804921b45939d514246d9ae2dac) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:45.547820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:45.552969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:45.565325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 214/429] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:45 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=3ad4a86440e943caac11daabeeb44957 => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:45.565325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.600486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 216/430] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:45.606626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.731999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:45.751763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93cca-98dc-4cb2-a0dc-61fa1e743f51 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.812572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:45.814028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.817487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.817929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] PATH_INFO: `/v3/projects/f2925804921b45939d514246d9ae2dac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.819643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] RBAC: Authorizing `identity:get_project(project_id=f2925804921b45939d514246d9ae2dac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:45.821127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:45.825354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 217/431] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:45 2022] GET /identity/v3/projects/f2925804921b45939d514246d9ae2dac => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:45.830314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.842411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a8dc0-16b0-4268-8464-2ad4e4e47ea3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.884460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:45.885672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:45.886186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:45.886688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:45.898831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:45.907486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:45.908419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 16:28:45.909570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:45.912741 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 215/432] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:45.919166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:45.961035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9763408-e4bd-4ab1-9ef5-3337b13bf995 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:45.986604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.003694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.004884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.005371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.006084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.007590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.009239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.011745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 218/433] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:45 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:46.020193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:46.047369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea326c-4608-4acb-b17f-08249dd7b15e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.058233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.092897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.093631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.093917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.094197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.095206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] RBAC: Adding query filter params (name=member) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:46.095514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.097382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397bf4-d102-4ad0-adf1-f36ade887766 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.106806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 216/434] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:28:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:46.108112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427346-e1fd-40ff-b63e-50d434770341 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.108401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427346-e1fd-40ff-b63e-50d434770341 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.108684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427346-e1fd-40ff-b63e-50d434770341 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.110231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 217/435] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:46.116283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.116572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.116856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.137641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:46.138836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:46.162801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fa951-914c-43af-afd7-8a193aa8532b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.203337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.203997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.204286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.204566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.205431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=f2925804921b45939d514246d9ae2dac) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:46.205757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.207370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.219629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 218/436] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:46.219629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:46.225495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 219/437] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=f2925804921b45939d514246d9ae2dac&role.id=e446eb256dc14055b69a04a154fdc373 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:46.249882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:46.294819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.379619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372b72-83d1-4881-a48d-0288cc3db89f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.381771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.397102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1da50-d6bc-4be4-b30f-80344ca0edae None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.437495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.438618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.439056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.439833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.445694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.446784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.447118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.447400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.463076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:46.474986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:46.475926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:46.476947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 220/438] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:46.482172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:46.539398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.540929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.620533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27e6b-3b92-4f37-a4f2-cd951e7c4133 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.620790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.669473 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.670177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.670461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.670746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.671587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:46.672011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.673940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f56b-8a0c-43b4-8dab-466e94e940d0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.687228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 221/439] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:46.689879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f23042-677e-4274-86ae-56cabef5873c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.690536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f23042-677e-4274-86ae-56cabef5873c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.691054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f23042-677e-4274-86ae-56cabef5873c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.691829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 219/440] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:46.694664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:46.695415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 222/441] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:46.699571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f23042-677e-4274-86ae-56cabef5873c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:46.717853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.836141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f23042-677e-4274-86ae-56cabef5873c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.845692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd58bbd-46dd-4a6a-b367-99082ccce604 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:46.884019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a4399-845f-49f0-9736-823f4470371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.884952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a4399-845f-49f0-9736-823f4470371a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.885244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a4399-845f-49f0-9736-823f4470371a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.885548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a4399-845f-49f0-9736-823f4470371a None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.887798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a4399-845f-49f0-9736-823f4470371a None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.887915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:46.887915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.887915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.888187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.888266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a4399-845f-49f0-9736-823f4470371a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.889975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 223/442] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:46.895812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:46.895812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:46.895812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:46.909379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:46.918063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:46.919280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:46.969744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:46.971324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:46.991404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 224/443] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:46.992584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.002372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.092715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 220/444] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:47.094270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.101230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e0f0c-d082-4f0d-ba25-e1dbccbe2dea None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.138503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.139445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.139733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.140014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.141252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.142779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.145004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 225/445] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:46 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:47.145794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.155690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.216214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f5fd0-d272-4172-a07e-384a59948872 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.229443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.259648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15183c6b-2eed-4da7-8a50-8e29e185fcc5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.263071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.264075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.264511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.264926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.276862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:47.285006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:47.286158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 221/446] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:47.287030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.298247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.299116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.299400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.300205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] PATH_INFO: `/v3/projects/5cad7076bb634184b26c7fbcf79495a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.301466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=5cad7076bb634184b26c7fbcf79495a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.302901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.304623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 226/447] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/projects/5cad7076bb634184b26c7fbcf79495a5 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:47.305702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.395554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6453578-f463-4cf7-bb5e-66c7a0ba0cbc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.404778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.405184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad86f57-3515-40a6-ba60-276dd0acf5c3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.430816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.431704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.431993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.432280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.433114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=e446eb256dc14055b69a04a154fdc373, scope.project.id=5cad7076bb634184b26c7fbcf79495a5) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:47.433463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.434953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.439423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.440113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.440913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.441041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 222/448] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=e446eb256dc14055b69a04a154fdc373 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:47.441199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.441861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.441958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:47.442309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.443617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.453505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 227/449] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:47.460275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.470169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.562097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92c4d4-74d4-47e5-adb9-d1edfcd46a9b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.571523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff663-3d8c-4937-beb0-c6dae7084534 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.603252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.604125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.604415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.604700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] PATH_INFO: `/v3/groups/a5252d37f38b40448ac9f946fea51ed4` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.605962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] RBAC: Authorizing `identity:get_group(group_id=a5252d37f38b40448ac9f946fea51ed4)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.608335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.610411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 223/450] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/groups/a5252d37f38b40448ac9f946fea51ed4 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:47.612750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.613418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.613706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.613986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.615820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.671251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.696045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.697538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.709585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.749559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ad399-9cf1-4652-b1f6-1765b1d9a4c2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.798563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.799232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.799586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.799937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.800791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] RBAC: Adding query filter params (group.id=a5252d37f38b40448ac9f946fea51ed4, role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=5cad7076bb634184b26c7fbcf79495a5) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:47.801112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.802608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.810105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 224/451] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/role_assignments?group.id=a5252d37f38b40448ac9f946fea51ed4&scope.project.id=5cad7076bb634184b26c7fbcf79495a5&role.id=3ad4a86440e943caac11daabeeb44957 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:47.814557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 228/452] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:47.821805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:47.930592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18351b-6170-485d-92f6-98dcb5b2dba2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:47.933010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:47.965793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:47.966663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:47.966945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:47.967223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] PATH_INFO: `/v3/projects/5b5dc23437bc45dfae144cb9e387649c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:47.968408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5dc23437bc45dfae144cb9e387649c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:47.970175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:47.972832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 225/453] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/projects/5b5dc23437bc45dfae144cb9e387649c => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:47.978656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:48.080379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86e07f-dcfe-46c4-93d4-bb5bf6b2cb99 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:48.088874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:48.116186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e3b63-8dc9-4242-86ef-a94ca8fc9b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:48.117133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e3b63-8dc9-4242-86ef-a94ca8fc9b46 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:48.117448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e3b63-8dc9-4242-86ef-a94ca8fc9b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:48.117733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e3b63-8dc9-4242-86ef-a94ca8fc9b46 None admin] PATH_INFO: `/v3/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:48.118958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e3b63-8dc9-4242-86ef-a94ca8fc9b46 None admin] RBAC: Authorizing `identity:get_group(group_id=5e3673f616ef4da2a0e7dd3e0ffab2ac)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:48.120417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e3b63-8dc9-4242-86ef-a94ca8fc9b46 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:48.122103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 229/454] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Jun 21 16:28:47 2022] GET /identity/v3/groups/5e3673f616ef4da2a0e7dd3e0ffab2ac => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:48.128555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:48.232289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5ad4-b7c4-42d3-bfff-6f9a434ebff9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:48.264286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:48.264944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:48.265227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:48.265535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:48.266369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] RBAC: Adding query filter params (group.id=5e3673f616ef4da2a0e7dd3e0ffab2ac, role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=5b5dc23437bc45dfae144cb9e387649c) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:48.266684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:48.268689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2062b9-e9a3-4bb5-a69b-41284fdaa6c1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:48.274833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 226/455] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Jun 21 16:28:48 2022] GET /identity/v3/role_assignments?group.id=5e3673f616ef4da2a0e7dd3e0ffab2ac&scope.project.id=5b5dc23437bc45dfae144cb9e387649c&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:50.728458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8959c-d49d-4082-ac0e-3e6bb5a66327 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:50.728949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8959c-d49d-4082-ac0e-3e6bb5a66327 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:50.728949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8959c-d49d-4082-ac0e-3e6bb5a66327 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:50.730580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 230/456] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:50.736006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728636-abb2-4e78-b07e-91403401cfb6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:50.736428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728636-abb2-4e78-b07e-91403401cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:50.736617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728636-abb2-4e78-b07e-91403401cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:50.754531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8f728636-abb2-4e78-b07e-91403401cfb6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:50.755786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8f728636-abb2-4e78-b07e-91403401cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:50.786569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:50.837337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 227/457] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:50.880668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8959c-d49d-4082-ac0e-3e6bb5a66327 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:50.919006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886978c3-0087-44bc-8c12-dc4897f44cd1 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:50.919612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886978c3-0087-44bc-8c12-dc4897f44cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:50.920072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886978c3-0087-44bc-8c12-dc4897f44cd1 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:50.922086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 228/458] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:50.931686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:50.932314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:50.932797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:50.951729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:50.953144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:51.053362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 229/459] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:51.076334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8959c-d49d-4082-ac0e-3e6bb5a66327 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:51.090189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:51.157838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:51.158819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.158976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.159245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.181050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:51.182639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:51.218344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:51.219515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:51.220336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:51.220336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:51.220336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:51.220336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:51.228455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 231/460] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:51.234952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:51.245688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:51.250628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca259b-2f2d-4ebd-a2b6-6aab45aa4f9c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:51.288156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:51.289643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.290113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.290567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.301969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:51.303769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:51.313642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c684b0a4-3fc5-4517-ab0b-547fa3e6ded2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:51.322752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:51.325375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:51.326504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:51.326504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:51.326504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:51.326504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:51.326504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 230/461] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:51.328061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e51d8-8b23-489e-9ca7-678ef78d05ab None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.328531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e51d8-8b23-489e-9ca7-678ef78d05ab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.328987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e51d8-8b23-489e-9ca7-678ef78d05ab None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.331455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 231/462] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:51.332337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e51d8-8b23-489e-9ca7-678ef78d05ab None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:51.392079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a84f28-cfb3-458b-8757-726992b65da8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:51.427178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:51.427847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.428365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.428471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.429186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:51.429538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:51.430987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd32f-ac42-451f-94c2-329b51166462 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:51.438514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e51d8-8b23-489e-9ca7-678ef78d05ab None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:51.453707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 232/463] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:51.455261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.456128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.456544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.473776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:51.474953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:51.477564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:51.478462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.478946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.479436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.480355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:51.480860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:51.482499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:51.495150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 232/464] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:51.496260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:51.520952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:51.557843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 233/465] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:51.558450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:51.621470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:51.656998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f185-bc7a-47af-bdbf-6844bf1b8299 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:51.703256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:51.704450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.704967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.706351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.707333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:51.709338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:51.727431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2de7f-3479-412c-91c7-4e799420d7c1 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:51.765713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c03ae-f1f5-4773-9450-5900731fd78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:51.766374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c03ae-f1f5-4773-9450-5900731fd78c None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.766661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c03ae-f1f5-4773-9450-5900731fd78c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.766944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c03ae-f1f5-4773-9450-5900731fd78c None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.767655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c03ae-f1f5-4773-9450-5900731fd78c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:51.769906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c03ae-f1f5-4773-9450-5900731fd78c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:51.817690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 233/466] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:51 2022] POST /identity/v3/users => generated 246 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:51.819121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:51.888182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 234/467] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:51 2022] POST /identity/v3/users => generated 248 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:51.889634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce70a1-9c46-469f-8782-d13c26185c9b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.889905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce70a1-9c46-469f-8782-d13c26185c9b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.890187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce70a1-9c46-469f-8782-d13c26185c9b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.901866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 235/468] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:51.907614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:51.907931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:51.908492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:51.933372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:51.958442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:51.962156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:51.998692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8c89f-2ef8-4b06-bb72-753e1b728496 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.056260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.057737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.058202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.059000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.074192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.076772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:52.100890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:52.101904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:52.102738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:52.102738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:52.102738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:52.102738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.102956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 236/469] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:52.104436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 234/470] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:52.110841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.113958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:52.123758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.257224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b3ae7-94e0-4fc2-ba4a-91b4f6970025 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.259129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d1f82-c3af-495f-bea6-314609d3a389 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.277352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:52.297322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.298949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.300130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.300577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.304009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.304683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.304967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.305251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.306014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:52.306323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.307696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55330d-4bd9-4350-a940-ad637cda0e4c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.314619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.316339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.323304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 237/471] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:52.324971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9af5af-98e5-45f5-963c-2480b1c7cee1 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.325937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9af5af-98e5-45f5-963c-2480b1c7cee1 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.326365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9af5af-98e5-45f5-963c-2480b1c7cee1 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.328064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 238/472] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:52.330301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9af5af-98e5-45f5-963c-2480b1c7cee1 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2edcee70-299f-460f-9570-b087336ef6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:52.348694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:52.349730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:52.350585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:52.350585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:52.350585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:52.350585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.351291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 235/473] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:52.352134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.352423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.352699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.376940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:52.379061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:52.423331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:52.455903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 236/474] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:52.455903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.490134 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9af5af-98e5-45f5-963c-2480b1c7cee1 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.534837 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.535524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.535807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.536084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.536800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.538494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.568675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:52.572923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a9584-c712-4588-9910-18cf1a4ade94 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.608210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.608867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.609168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.609480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.610228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:52.610561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.612523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.628971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 237/475] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:52.628971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.638228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 239/476] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:52 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:52.640583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.841721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6a864-65fa-4d8c-8460-ffcaf6a37d74 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.847300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80862-2d37-47d7-8c97-b404d87e73ff None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:52.866721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:52.880502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.881484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.886543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.886543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.886543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.886543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.886823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:52.886823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:52.886823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:52.886823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:52.887310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:52.889074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:52.925431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.sql.core [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 16:28:52.925431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 16:28:52.925431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [parameters: {'id': 'e1607e7832af4ab2b06a94857d5d314b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 16:28:52.925431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80609) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application conn.query(q) Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result.read() Jun 21 16:28:52.943268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 16:28:52.944145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application next(self.gen) Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application yield resource Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application next(self.gen) Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise self.value Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application session.commit() Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 16:28:52.945041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.session.flush() Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application compat.raise_( Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 16:28:52.945960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 16:28:52.947459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application conn.query(q) Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result.read() Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 16:28:52.949238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [parameters: {'id': 'e1607e7832af4ab2b06a94857d5d314b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:52.951203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 16:28:52.953062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:52.955075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 238/477] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Jun 21 16:28:52 2022] POST /identity/v3/roles => generated 144 bytes in 322 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:52.955075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:52.981554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:53.058017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd0716-7b3b-424b-a5fb-1bec5e0d337b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:53.091174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b396c57-de89-4c6a-9f0f-72a8b9f3ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:53.092042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396c57-de89-4c6a-9f0f-72a8b9f3ff16 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:53.092357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396c57-de89-4c6a-9f0f-72a8b9f3ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:53.092632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396c57-de89-4c6a-9f0f-72a8b9f3ff16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:53.099977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 240/478] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:52 2022] POST /identity/v3/users => generated 249 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:53.104636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b396c57-de89-4c6a-9f0f-72a8b9f3ff16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0b396c57-de89-4c6a-9f0f-72a8b9f3ff16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:53.113773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:53.114732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:53.115510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 239/479] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:53.121781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:53.311857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35597b-1de8-4102-941c-ea8e01744a50 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:53.348801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:53.349512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:53.349802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:53.350086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:53.350905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:53.357096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:53.357096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e2609-ec3b-49d1-ae48-8b4de81e9089 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:53.365659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 241/480] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:54.217365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a0ef-29c1-48b5-a929-fdd462a8c4c4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.217881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a0ef-29c1-48b5-a929-fdd462a8c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.217956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a0ef-29c1-48b5-a929-fdd462a8c4c4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.219855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 240/481] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:54.225857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.226278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.226492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.250340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:54.251549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:54.312554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:54.346977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad0bcb-6cb5-4561-945d-b2cc8fca6b3d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.347393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad0bcb-6cb5-4561-945d-b2cc8fca6b3d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.347562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad0bcb-6cb5-4561-945d-b2cc8fca6b3d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.348957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 241/482] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:28:54.359499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.360109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.360398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.371276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 242/483] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:28:54.398287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:54.399482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:54.423356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:54.515973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 242/484] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:54.535031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862491b-158c-4397-8211-0e31909f4d58 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:54.560811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:54.577221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:54.578327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.578805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.579270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.590263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:54.600683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:54.613139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:54.614052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:54.615272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:54.622081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 243/485] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:28:54.629195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:54.683426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:54.774171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618f18-7199-47d2-ba5e-154b108f7483 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:54.821332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9abe9-7e2c-4d9d-a074-cb3152071b0b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:54.821925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:54.823141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.823728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.824197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.847161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:54.852851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:54.857299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:54.857299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:54.857299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:54.857299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:54.857299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:54.857299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:54.860878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:54.862096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:54.863005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:54.865724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 243/487] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:54.869460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 244/487] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:54.870922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:54.871056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:54.958808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:54.992553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4a2c5-9350-446c-b014-10b0b3e046f3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.034127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.040522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.041062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.041578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.042690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:55.043195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.044786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.056599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 244/488] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:55.066106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.072602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:55.096653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841742d5-9224-48a6-817c-805d6a0ae117 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.164342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.165126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.165441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.165724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.183546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7aca-7663-49f5-8970-916e340a6a13 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.191650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.193169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:55.228482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:55.230046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:55.230866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:55.230866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:55.230866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:55.230866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:55.230866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 245/489] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:55.234151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.234588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.235392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.235678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.235953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.239640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:55.248526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.250544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:55.281206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:55.282082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:55.282934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:55.282934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:55.282934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:55.282934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:55.282934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 245/490] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:55.288057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.402191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c106dc-7562-4c23-8b11-8840620cb1a2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.419769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55620-b1e8-40db-ba9a-c7ad3436d3c6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.439969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.440823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.441226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.441630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.442360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:55.442676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.444063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70992e0-c4ae-431d-b4f3-7c4e0fb25897 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.458416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:55.460500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.461519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.462001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.462522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.463457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:55.463960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.465589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef92c-24da-4233-83ab-ba5f2bb46722 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.467421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 246/491] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:55.469684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0249563-081a-4699-a6c9-d79881c100ad None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.469975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0249563-081a-4699-a6c9-d79881c100ad None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.470250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0249563-081a-4699-a6c9-d79881c100ad None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.477967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 247/492] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:55.479797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0249563-081a-4699-a6c9-d79881c100ad None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.487016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 246/493] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:28:55.488485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.488779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.489096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.512052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:55.513487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:55.566117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:55.596827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 247/494] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:55.598119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.606377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0249563-081a-4699-a6c9-d79881c100ad None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.663428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.664938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.665675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.666614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.680930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.682797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:28:55.707030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:55.707980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 16:28:55.708872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:55.717403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 248/495] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:55.717403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.737892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196ff8f-6a2e-49bf-9b7b-87e3e195262e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.782801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:55.789302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.790901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.791755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.792233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.804739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.806288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:28:55.824388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:55.825469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:55.826364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 248/496] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:55.826929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.836014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96a305-85b0-4ff5-9158-988f1da7461a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.866544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:55.871883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413ca25-8970-4862-8a55-bb423a1a84e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.872668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ca25-8970-4862-8a55-bb423a1a84e8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.872952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ca25-8970-4862-8a55-bb423a1a84e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.873230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ca25-8970-4862-8a55-bb423a1a84e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.884475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413ca25-8970-4862-8a55-bb423a1a84e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-2413ca25-8970-4862-8a55-bb423a1a84e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:55.892734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:55.893965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:55.894769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 249/497] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:55.895422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035496b1-5aeb-4793-8253-6ae823e05921 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.895889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035496b1-5aeb-4793-8253-6ae823e05921 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.895889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035496b1-5aeb-4793-8253-6ae823e05921 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.901096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 250/498] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:55.901096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035496b1-5aeb-4793-8253-6ae823e05921 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:55.945077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f989e-6b3d-4aaa-ab79-a3f861e75ff0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:55.980265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:55.980934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:55.981221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:55.981533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:55.982375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:55.982746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:55.984221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.008118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035496b1-5aeb-4793-8253-6ae823e05921 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.022225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 249/499] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:56.023096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.028596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.042660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.043327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.044705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.044705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.044968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:56.045109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.046552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11d3b5-ccb4-45af-84ba-bfb0cd8af2fc None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.083530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 251/500] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:28:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:56.085177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486e10-5b6b-4a13-8906-53db12da15ad None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.085622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486e10-5b6b-4a13-8906-53db12da15ad None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.086048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc486e10-5b6b-4a13-8906-53db12da15ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.103218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-dc486e10-5b6b-4a13-8906-53db12da15ad None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:56.104470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-dc486e10-5b6b-4a13-8906-53db12da15ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:56.123710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.130536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634447b-9286-451a-9845-c29eeb251549 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.164743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.165539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.166097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.166592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.167389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:56.168070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.169503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.172314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 252/501] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:56.174429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df5976-9f0a-4cd7-a8f3-179989a55409 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.174709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df5976-9f0a-4cd7-a8f3-179989a55409 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.174892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df5976-9f0a-4cd7-a8f3-179989a55409 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.176341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 253/502] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:28:56.177030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df5976-9f0a-4cd7-a8f3-179989a55409 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.188116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 250/503] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:56.188950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.289008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df5976-9f0a-4cd7-a8f3-179989a55409 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.295907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3dd84-a857-46f1-a87c-3bf91a0c3d23 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.302048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.323426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc15ac-e266-4247-ae90-5dfe7a5d5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.324070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc15ac-e266-4247-ae90-5dfe7a5d5958 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.324353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc15ac-e266-4247-ae90-5dfe7a5d5958 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.324636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc15ac-e266-4247-ae90-5dfe7a5d5958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.329137 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.329856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.330857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.331173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.355940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.393993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc15ac-e266-4247-ae90-5dfe7a5d5958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.395475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc15ac-e266-4247-ae90-5dfe7a5d5958 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.397655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.399104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.496316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 254/504] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:56.501680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 251/505] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:56.501848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.501848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.502014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.502152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.515369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:28:56.518021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:28:56.521286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.558626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.588799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 255/506] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:28:56.589671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.606762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214d33-3932-47bd-8660-8151c38dd354 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.641432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.642227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.643104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.643386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.653257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.654740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:56.672375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:56.673391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:56.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:56.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:56.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:56.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:56.678231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 252/507] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:56.678946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.690888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284be1e-c4bf-47ed-9639-9d7e726bee21 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.726883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.727719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.728010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.728291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.735003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.739390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:28:56.747179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:56.749434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 256/508] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:56.750229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.787164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520684b-0a54-40b7-9262-ba4a723ad6bf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.796405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.822473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.823802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.824208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.824491 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.837046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.838569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:56.856084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:56.857057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:56.858123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:56.858123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:56.858123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:56.858123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:56.858123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 253/509] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:56.858123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.862390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260b7c8-0632-40d8-8b65-bb37a83e6577 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.903221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.904023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.904313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.904597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:56.915709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:56.917233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:56.934452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:56.935513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:56.936580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:56.936580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:56.936580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:56.936580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:56.936580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 257/510] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:56.936580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:56.962790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212f069-a418-45d2-b2cd-42bb3102a005 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:56.987117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:56.997163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:56.997978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:56.998263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:56.998549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.009693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.011215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:57.028904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:57.030020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:57.030926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:57.030926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:57.030926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:57.030926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:57.030926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 254/511] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:57.031361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.041515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e251-ebe8-4107-91de-c077026df0d7 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.046261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.075889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.076549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.076841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.077120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.077878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:57.078192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.079564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.091590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 258/512] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:57.092404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.135154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48ec5f-9902-4a62-a75f-96bbbfbadf72 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.168436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.169111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.169433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.169727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.170482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:57.170797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.172192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.180892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 255/513] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:57.181735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.197782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a625-0ace-48b8-bc0e-4e0b842001f5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.209838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.235072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.235722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.236006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.237306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.238103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:57.238433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.239799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.251105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 259/514] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:57.253079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.272360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.297155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94111a-0c08-43fb-92b1-b0a0feca8b8c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.332125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.332818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.333108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.333418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.334201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:57.341360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.341360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.348235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 256/515] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:57.349103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.413300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcc21-f9d4-40ab-8ecd-89bd642ef918 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.447100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.447750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.448033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.448310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.449027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:57.449363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.450726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.462664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 260/516] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:57.463798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.479639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a85b0-61e9-4ce1-91c5-9948e064b974 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.496062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.515853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.516647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.516937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.517222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.519634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.525603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.527081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:28:57.542709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:57.543766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 257/517] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:57.544682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.573722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f74e1-9163-40ee-bc84-b30037947b46 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.609053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.609868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.610152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.610429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.620306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.621805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:57.639521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:57.640372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:57.641204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:57.641204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:57.641204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:57.641204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:57.641204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 261/518] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:57.641509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.651752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8fc9-a61b-4ab1-8be4-cf962f4a42d3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.686825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.687542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.687846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.688104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.695602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.697071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:28:57.712136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:57.713212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:57.714207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 258/519] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:57.714772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.725649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.746411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb598-4830-4d0d-b07f-411651ca5294 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.770762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.782877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.783687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.783972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.784248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.790820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.792269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:28:57.806869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:57.807875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:57.808942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 262/520] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:57.809611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.815965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506738b-75f9-4896-95d7-88296f22dac9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.850777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.851477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.852124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.852417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.853499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.854948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.908993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9101122-7fc4-4273-a144-b74bfd7f3823 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:57.943968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:57.943968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:57.944229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:57.944397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:57.945234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:57.945587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:57.947023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:57.961796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:57.965149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 263/521] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:57.965958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:57.981158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 259/522] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:28:57 2022] POST /identity/v3/users => generated 247 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:28:57.982273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.084438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4de14-c2b1-477a-9a7a-d2d05d895b2b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.110548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60830d7-dd43-4a28-8cd6-6923159f8595 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.123196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.125029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.125735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.126027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.126493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.128157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:58.128504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.130111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.142041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 264/523] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:58.143987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.148949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.149653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.149940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.150222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.151013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:58.151326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.152801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.172053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 260/524] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:58.172906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.212114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.256873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792ad60-9ea0-4c97-a87e-34d46cde4058 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.300125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.301043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.301359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.301628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.302420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:58.302735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.304241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.306656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642704e-66fd-4aaf-bd0c-cfa146551c59 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.329469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 265/525] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:58.329469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.358478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.359402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.359694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.359975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.405869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.431920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8f44c-a859-4db5-a312-6f3627eae526 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.435466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.436943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.456775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.472023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.472803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.473092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.473401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.480834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.482407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:28:58.499234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:58.500359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:58.501268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 266/526] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:58.501882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.551127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 261/527] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:28:58.552130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.612132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775efc3d-2a49-426c-a29e-2ed41cb0cf74 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.629468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.650149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.651092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.654984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.654984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.654984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=1eee79db5d38448fb7e3c40be668a3cc) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:58.654984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.655493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.662772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01421cb7-b74e-405f-8e7a-4fa6a6803cf1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.674175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 267/528] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/role_assignments?user.id=1eee79db5d38448fb7e3c40be668a3cc&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:58.674175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.704899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.706031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.706325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.706609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.707510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=9687c85240694148aa572d8807ada25b) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:58.707839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.709380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.724120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 262/529] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/role_assignments?user.id=9687c85240694148aa572d8807ada25b&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:58.724120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.761780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.867996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dadb-82a3-42af-8c1b-acaa302402a9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.907122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4443-28f5-47c5-96f7-cb5c30d71c94 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:58.917322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.917322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.917322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.917322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.917682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:58.917682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.918465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.957240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad311814-9853-4207-836e-43a30e683212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:58.958212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad311814-9853-4207-836e-43a30e683212 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:58.958438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad311814-9853-4207-836e-43a30e683212 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:58.958645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 268/530] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:58.958743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad311814-9853-4207-836e-43a30e683212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:58.964495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:58.965092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:58.987664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad311814-9853-4207-836e-43a30e683212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:58.987664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad311814-9853-4207-836e-43a30e683212 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ad311814-9853-4207-836e-43a30e683212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:58.998986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:58.999975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:59.001251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:59.001251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:59.001251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:59.001251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:59.001251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 263/531] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:59.013302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad311814-9853-4207-836e-43a30e683212 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:59.146451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6eb96-c700-425c-b00b-5019da54f4cd None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:59.159727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad311814-9853-4207-836e-43a30e683212 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:59.162785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:59.196052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:59.196871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:59.197170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:59.197478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:59.219375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:59.220945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:59.221439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:59.221910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:59.222661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:59.222973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:59.224507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:59.253346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 264/532] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:59.262126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:59.291731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:59.294544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:59.355041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:59.418069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460710b2-9aa4-4a9d-9e9f-8996c58a5da4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:59.452766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:59.453980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:59.454489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:59.455609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:59.462924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:59.464617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:28:59.480272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:59.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:28:59.482014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:28:59.484417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 265/533] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:59.493321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:59.518694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 269/534] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:28:59.525389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:59.542307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:59.665305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23705f1-aff1-4aad-a350-65227bc4e01d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:59.690338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544ff8-92ca-4aa6-8d63-1cd56132d21f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:59.697303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:59.697303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:59.697303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:59.697303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:59.708378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:59.709914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:59.717787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:28:59.729129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:28:59.738906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:28:59.739746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:28:59.739746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:28:59.739746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:28:59.739746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:28:59.739746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 270/535] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:28:59.739746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:59.786659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:59.787253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:59.787590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:59.787882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:59.788674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:59.788987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:59.790466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:59.798750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:28:59.821440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 266/536] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:59.826304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:28:59.854301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbcc79-97c8-4de1-950a-a8af9ddca4f0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:28:59.895239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:28:59.895909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:28:59.896337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:28:59.896603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:28:59.898622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:28:59.898945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:28:59.900327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:28:59.925452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 271/537] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:28:59.932741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:00.067354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b686-b863-4aa4-a085-34e135a3beaa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:00.083665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc918e9-6596-40a3-8dc9-6c32fc14435d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:00.102755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:00.133147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:00.134363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.134873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.135350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.146626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:00.148303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:00.163519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:00.164533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.165036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.165538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.166629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=8f5efc58077843358aeb93e42997f2c3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:00.167152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:00.168889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-b60578c2-c62e-403d-b227-c50e56e0e964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:00.177159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:00.178061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:00.178885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:00.182560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 267/538] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/role_assignments?user.id=8f5efc58077843358aeb93e42997f2c3&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:00.191302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 272/539] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:00.196782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:00.239709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663bcf-75e9-4e63-9ebc-10cda39d8496 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.240768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663bcf-75e9-4e63-9ebc-10cda39d8496 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.241336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663bcf-75e9-4e63-9ebc-10cda39d8496 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.245198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 273/540] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:00.250572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.251170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.251933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.270997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:00.287628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:00.288943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:00.353754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99031-ce3d-4d03-8db2-062bd8f4c9f7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:00.393195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:00.394762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.395253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.395771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.396874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:00.397418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:00.399186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:00.414113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 268/541] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:00.420122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:00.429840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 274/542] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:29:00.453979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:00.516558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:00.526932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7161a-1ff3-4a64-88aa-f19ec54db163 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:00.566613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:00.567278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.567566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.567837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.568681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=1097be6c3ab44dd1a3532926235e980c) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:00.569159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:00.570656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:00.586497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 269/543] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:00 2022] GET /identity/v3/role_assignments?user.id=1097be6c3ab44dd1a3532926235e980c&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:00.665471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733b9ee-8e27-4153-9542-ee1968d40916 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:00.667874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:00.706329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:00.707509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.707797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.708234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.722126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:00.730272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:00.731276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:00.732101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 275/544] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:00.738054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:00.879451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7041-ee18-4a09-8f97-621884989f8d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:00.915800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:00.916838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:00.917362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:00.917851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:00.918799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:00.919318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:00.920918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:00.931306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 270/545] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:00.936557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.112360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bd87-9d67-4f3f-a5a9-5e638f4ef47c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:01.163079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:01.163927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.164218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.164494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.180117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:01.181531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-9cf0f4e8-813a-4361-8867-3dfba7828f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:01.199719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:01.200659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:01.201641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:01.201641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:01.201641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:01.201641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:01.201641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 276/546] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:01.206943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.241427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:01.336563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43e4c-e80f-4a4c-b2e9-de52fe36919e None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.336883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43e4c-e80f-4a4c-b2e9-de52fe36919e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.337461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43e4c-e80f-4a4c-b2e9-de52fe36919e None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.338685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 277/547] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:01.340690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207a0f4-6d20-4f6b-b11d-0346dda75c52 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.341167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207a0f4-6d20-4f6b-b11d-0346dda75c52 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.341654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207a0f4-6d20-4f6b-b11d-0346dda75c52 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.343172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 278/548] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:01.344718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f089c-9cdb-4dbe-b792-047fd20b269f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.345267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f089c-9cdb-4dbe-b792-047fd20b269f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.345763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f089c-9cdb-4dbe-b792-047fd20b269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.363323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-003f089c-9cdb-4dbe-b792-047fd20b269f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:01.364516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-003f089c-9cdb-4dbe-b792-047fd20b269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:01.376191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:01.393989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361e56-903b-432d-a735-d61b4f54c40f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:01.435701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:01.436319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.436609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.436892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.437924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:01.438236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:01.441235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:01.451983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 279/549] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:01.453645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.454176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.455215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.464519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 271/550] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:01.469833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.475381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:01.477770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:01.574544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:01.575566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 280/551] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:01.576608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.602120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085166b-ebfc-48b4-9c2c-bf73170c5570 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:01.640875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:01.642434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.642731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.643010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.652693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:01.655411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:01.669589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:01.677774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:01.680869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:01.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:01.682546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 272/552] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:01.683527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.696770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c7fe2-8d2e-4311-984f-89ac5843cf2f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:01.734336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:01.735322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.736267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.736741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.747678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:01.756587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:01.757804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:01.758843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:01.765702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 281/553] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:01.766662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.813374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8808-6fb6-4fe5-98d4-810679534bd2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:01.849797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:01.850827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.851160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.851578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.854839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:01.863902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:01.872279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:01.873478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:01.874393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:01.875080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 273/554] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:01.876184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.902134 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfc2bb-fde9-4522-969b-412b95a896b6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:01.938140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:01.939147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:01.939605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:01.940039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:01.941043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:01.941540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:01.943174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:01.961785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:01.964668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 282/555] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:01.971099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:01.991610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfbfd1-1f24-4496-9f45-7ab5c4b10ed1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.029865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.030724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.031101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.031453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.032276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:02.033273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.034912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.044359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 274/556] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:02.050498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.096477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c8066-eea5-4856-a860-40384a7de523 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.129858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.134365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.135132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.135656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.135766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.136573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:02.136955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.138516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.152277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 283/557] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:02.153796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.181423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05f30-be26-4179-ad22-b24d2092980e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.225358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.231587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.234277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.234277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.234277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.286437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad014cb-fee9-4bd1-9e39-443321212fff None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.323721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.324548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.324841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.325126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.329001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.332422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.337431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.338788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:02.357790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:02.358697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:02.359564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:02.359564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:02.359564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:02.359564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:02.363838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 284/558] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:02.364759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.402541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.448730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 275/559] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:02.450031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.475722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa905c5-2a85-4653-a768-061a95f270d9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.485669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.513148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.514080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.514367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.514687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.526938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.529733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:02.549086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:02.550139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:02.551017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:02.551017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:02.551017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:02.551017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:02.551017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 285/560] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:02.551774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.566038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840acb6-7d19-41d6-abec-54acbdfa48b9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.603024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.603698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.603988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.604275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.605004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:02.605339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.606754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.623218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 276/561] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:02.623916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.644686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.661462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19053-2347-4390-ac47-1dbe7eb49f7b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.697387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.698178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.698462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.698741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.711702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.713410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-714a7b77-aa43-4767-97ae-57083b64f182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:02.731314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:02.732299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:02.733193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:02.733193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:02.733193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:02.733193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:02.733193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 286/562] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:02.733832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3793-9e37-4ab0-9d59-eac513e2f41b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.733924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3793-9e37-4ab0-9d59-eac513e2f41b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.734631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3793-9e37-4ab0-9d59-eac513e2f41b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.735863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb7c77-8eef-4150-b313-c85a5d528093 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.736784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 287/563] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:02.737515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3793-9e37-4ab0-9d59-eac513e2f41b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.756042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.780398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.781066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.781393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.781712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.782440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:02.783019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.784805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.796861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 277/564] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:02.797793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:02.857482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3793-9e37-4ab0-9d59-eac513e2f41b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.881405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:02.896026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.896954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.897246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.897558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.904663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5cadc-270f-4338-ba73-a11592f08c1c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:02.904982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.906551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-83673158-07ca-4264-a92a-9fb56728bac8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:02.921973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:02.922966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:02.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 288/565] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:02.925244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc081-0cdd-4d12-ae45-c15c989bbaac None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.925244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc081-0cdd-4d12-ae45-c15c989bbaac None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.925417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc081-0cdd-4d12-ae45-c15c989bbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.943465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5bcdc081-0cdd-4d12-ae45-c15c989bbaac None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:02.944756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5bcdc081-0cdd-4d12-ae45-c15c989bbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:02.946207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:02.946883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:02.947169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:02.947447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:02.948184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:02.948501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:02.949929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:02.965644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 278/566] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:02.966494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.027984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 289/567] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:03.030671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200eb42-d389-4bc3-9c94-82076a5c195f None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.031156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200eb42-d389-4bc3-9c94-82076a5c195f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.031594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200eb42-d389-4bc3-9c94-82076a5c195f None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.033452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 290/568] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:03.034368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200eb42-d389-4bc3-9c94-82076a5c195f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.037232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.085567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f6b7-fa2f-419f-8b46-1e7b8cf704fb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.125007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.125842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.126130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.126980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.135057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.136539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.138589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:03.151636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:03.152827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 279/569] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:03.153957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.162959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200eb42-d389-4bc3-9c94-82076a5c195f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.198895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.199563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.199853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.200133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.200979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:03.201321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.202760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41e88b-be38-40f1-852a-6b8cec65b592 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.220170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 291/570] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:03.221657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.221955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.222241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.238632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:03.239830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:03.272539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537513df-e0e5-4e14-94b1-82ca119f16d1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.301197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.310791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.311592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.311878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.312157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.314604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 292/571] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:03.315566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.325083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.328010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:03.342046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:03.343185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 280/572] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:03.344413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.427131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.438407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4914ddc-30c9-48d2-a21b-225f182bcef3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.467582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c296029-947f-4629-a6e1-60677e280e72 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.473712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.474515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.474868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.475198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.485505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:03.494195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:03.495279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:03.496108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 293/573] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:03.497036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.508770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.509474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.509761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.510045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.510884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:03.511200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.512639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.530058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 281/574] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:03.530974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.551658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.602637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0545af1-245d-438c-8e5c-3fed781e0ce5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.635303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eecb4-bae0-4543-a96a-b77fbfe38a58 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.636528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.637352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.637669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.637945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.648538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.650025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.652115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:03.667412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:03.668496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:03.669819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:03.669819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:03.669819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:03.669819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:03.670476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.671266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.671558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.671884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.673213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 294/575] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:03.675012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.683248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:03.691253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:03.692537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 282/576] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:03.693605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.781204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef17ce8-c949-4174-b198-b08ee565d43e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.783422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.799604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4e841-0ae9-4699-bf3b-45e89c4878db None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.816535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.817417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.817998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.818596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.819363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:03.819676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.821091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.833451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 295/577] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:03.833926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.834319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.834606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.834899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.835179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.835932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:03.836243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.837659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.847079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 283/578] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:03.847887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:03.887299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:03.942199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34adb-1388-452d-a3ff-1c7bacf621eb None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.948753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe21d9-7d1e-4680-8269-8f756fe9b613 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:03.977979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.979372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.979372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.979372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.984978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:03.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:03.986510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:03.986815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:03.987537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:03.987855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.989215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:03.990304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:03.991865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.000749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 284/579] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.002183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:04.009969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:04.011054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:04.012208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:04.012208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:04.012208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:04.012208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:04.012208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 296/580] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:04.012208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.029159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.103089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.106785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671912-e471-406a-941a-c877b79c0b1e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.115071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de28b7-b466-4bf7-b6f7-515a26178407 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.143742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.144659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.144942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.145223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.145997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:04.146308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.147690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.149064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.149746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.150033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.150316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.151147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=4f3bfddef4664aad9d210fbeb52acda9) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:04.151466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.152891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.155813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 285/581] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.156742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.158808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 297/582] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/role_assignments?user.id=4f3bfddef4664aad9d210fbeb52acda9&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.165673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.266414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.281745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826ff1-9a8d-4f92-9176-13ae6fc7a994 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.292070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c59e45-6fd3-4ee1-b1e2-170fedd03ff9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.328753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.330249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.330534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.330819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.332109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.333306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.343303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.343303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.343780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.343871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.343966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.345033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:04.360554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:04.361772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:04.362861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:04.363383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:04.364323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:04.365590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:04.365590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:04.365590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:04.365590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:04.371193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 298/583] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:04.371193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.371418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 286/584] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:04.371418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.404698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.495512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330c52-734d-4e73-8e76-40a9b869666e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.497622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4b82f-6428-407d-a629-7017c58e208b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.532611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.533649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.533975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.534098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.534311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.534677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.534965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.535248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.535977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:04.536291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.537760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.544925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.546175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.547738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.551597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 299/585] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.552303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:04.572803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:04.573794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:04.574663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:04.574663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:04.574663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:04.574663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:04.578706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 287/586] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:04.579469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.646849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.662564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475e969-3477-4a8b-9162-75d8aaf849c2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.687444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f519e-6922-481a-a439-69a67e510ce1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.700195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.700866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.701156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.701461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.702194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:04.702505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.703872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.716281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 300/587] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.722025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.726917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.727883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.728403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.728914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.729965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:04.730563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.732347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.746596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 288/588] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.747671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.787369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.832847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a823d-f87d-42d0-8503-169f0b07509c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.865304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a16ea-4671-4f7b-8d8f-c4d82d6a9262 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:04.870931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.871737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.872027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.872309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.881542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.882971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.892330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:04.898231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:04.899136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:04.900066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 301/589] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:04.900633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:04.910367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:04.910889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:04.911192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:04.911475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:04.912225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:04.912710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:04.914165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:04.927401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 289/590] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:04.928284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.016281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d7911-4f24-4f4c-8c82-d0d2d401407e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.034598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444f7e-0063-4aa5-9ed5-a8060b2182a6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.035554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:05.053653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.054619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.054911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.055191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.062486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.063935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.070418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.071309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.071597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.071877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/9687c85240694148aa572d8807ada25b/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:05.078370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:05.079722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:29:05.080911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:05.083927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 302/591] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:05.084942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.090516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=9687c85240694148aa572d8807ada25b, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.091973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.165141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 290/592] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:04 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/9687c85240694148aa572d8807ada25b/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:05.175366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.196222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccf74c-5449-4aed-b9c4-cdde8b82daec None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.232188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:05.242266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.242891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.243238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.243575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.244563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:05.244982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.246563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.261946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 303/593] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:05.263066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.320075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:05.345931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5983d0-430e-4ef7-9a87-4605a0307642 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.392180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.393665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.394097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.394303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.398063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615f1a-4995-4cb6-af0c-97da2329300d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.402424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.403897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:05.419746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:05.420890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:05.422029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 291/594] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:05.426384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.443365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.444193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.444827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.445596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.446555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:05.446971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.449006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.473167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 304/595] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:05.478571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.538218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:05.545760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d0a95-c196-4cd6-b2ec-8be6b3675d0a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.581465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d75fd-96e2-43cc-962a-a31c2df78800 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.582770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.583872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.584345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.584455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:05.584902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/1eee79db5d38448fb7e3c40be668a3cc/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.601761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=1eee79db5d38448fb7e3c40be668a3cc, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.603573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.619788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.620466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.620753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.621062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.622050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:05.622296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.623736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.644020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 305/596] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:05.645425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.678776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 292/597] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:05 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/1eee79db5d38448fb7e3c40be668a3cc/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:05.679959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.785263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15428b27-6214-4a25-856b-b0586e8ddb7d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.830718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755802-39b0-4d01-95a8-23df9283fc18 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:05.867529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.868361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.868925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.868925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.874206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:05.875470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:05.876677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:05.877193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:05.889773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.891449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:05.892541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.894007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:05.896141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:05.913637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:05.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:05.915511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:05.915511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:05.915511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:05.915511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:05.915821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:05.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:05.919952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:05.919952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:05.919952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:05.919952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:05.919952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 306/598] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:05.922061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 293/599] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:05.927274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.930355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:05.946672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:06.087776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e70b-f044-44e0-9956-e61157fb66d3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.126095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91766d-a144-448c-bc1e-9e756c53dc2f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.148327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.149001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.149303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.149594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.150329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:06.150641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.152017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.173901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 307/600] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:06.182409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:06.189719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.190397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.190684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.190965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.192806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:06.193236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.194787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.208940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 294/601] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:06.214491 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:06.293946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:06.330329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fa364-6cb1-4357-9b8c-96506b888b1a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.368708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.369638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.369927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.370211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.372817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:06.378916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.380534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:06.396062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:06.396999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:06.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:06.403601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 295/602] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:06.405316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:06.423462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484048a-bc27-48a4-bbea-5de612f07f7a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.462941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.463768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.464064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.464353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.472429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.474041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-b86eb5c2-c31a-4a7b-98d3-10834976003d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:06.489916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:06.490870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:06.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:06.493255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 308/603] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:06.493255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0c71-1252-4396-a689-1ad776305f0d None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.493552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0c71-1252-4396-a689-1ad776305f0d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.495272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0c71-1252-4396-a689-1ad776305f0d None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.495272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 309/604] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:06.499969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0c71-1252-4396-a689-1ad776305f0d None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:06.523955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30b6cc-dbd3-46b3-8b5a-2c4719d85918 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.541270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:06.560205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.560801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.561093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.561405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.562202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:06.562506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.565338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74dd8c-a5a7-4a6b-9dbb-bad85591ef08 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.584925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 296/605] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:06.586487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.586747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.587035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.605311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:06.606606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:06.614570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0c71-1252-4396-a689-1ad776305f0d None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.644508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:06.653853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.654821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.655259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.655693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.656655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:06.657258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.658979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.671945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 310/606] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:06.673057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:06.690108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 297/607] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:06.691133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:06.784810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b19da-6d79-485e-b3a6-f616dc942edf None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.818016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600846-7c26-4ffe-8eba-ff0dc584a52d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:06.822951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.824057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.824518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.824972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/8f5efc58077843358aeb93e42997f2c3/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.825692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:06.841875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=8f5efc58077843358aeb93e42997f2c3, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.843897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:06.854493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:06.855443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:06.855826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:06.856129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/1097be6c3ab44dd1a3532926235e980c/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:06.871690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=1097be6c3ab44dd1a3532926235e980c, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:06.873205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:07.000453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 311/608] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:06 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/8f5efc58077843358aeb93e42997f2c3/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:07.002292 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:07.040250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 298/609] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:06 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/1097be6c3ab44dd1a3532926235e980c/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:07.052513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:07.129120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7e1d-ade7-4a68-aff7-099ffeb034a1 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:07.169561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59c2ab-f5f7-437c-bb6e-56f521762d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:07.170427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c2ab-f5f7-437c-bb6e-56f521762d3e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.170712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c2ab-f5f7-437c-bb6e-56f521762d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.170987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c2ab-f5f7-437c-bb6e-56f521762d3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.183460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59c2ab-f5f7-437c-bb6e-56f521762d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-ba59c2ab-f5f7-437c-bb6e-56f521762d3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:07.193839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:07.194841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:07.195692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 312/610] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:07.201562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:07.349130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456b96-c9dd-4926-8a96-2881e67e7e54 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:07.403412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:07.404099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.404383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.404662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.405559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:07.405870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:07.407310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:07.417683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 299/611] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:07.420208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff598c5f-3f72-4177-ab30-7ea42123f4a5 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.420517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff598c5f-3f72-4177-ab30-7ea42123f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.420791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff598c5f-3f72-4177-ab30-7ea42123f4a5 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.422576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 313/612] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:07.423191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:07.427830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6842e-d626-450a-9968-137586c2323e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.428389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6842e-d626-450a-9968-137586c2323e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.428892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6842e-d626-450a-9968-137586c2323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.449014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:07.449976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-16d6842e-d626-450a-9968-137586c2323e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:07.450940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-16d6842e-d626-450a-9968-137586c2323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:07.564831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 314/613] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:29:07.598926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fece8-4876-4215-a64c-191d19493d92 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:07.624756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6842e-d626-450a-9968-137586c2323e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:07.655236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:07.657590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.658264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.659597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.677955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:07.683579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:07.685381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:07.716726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:07.718021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:07.719170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:07.719170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:07.719170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:07.719170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:07.729798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 300/614] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:07.732057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:07.831621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:07.834209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6842e-d626-450a-9968-137586c2323e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:07.883680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf37d0-14d7-4e82-9be2-24538b7b09b4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:07.903332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:07.904128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.904407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.904746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.925432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:07.933977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:07.934887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:07.935730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:07.936913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 315/615] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:07.941028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:07.952486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:07.953165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:07.953488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:07.953770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:07.955217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:07.955567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:07.957039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:07.972213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 301/616] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:07.977596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.093944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b9f9b-4b0b-49a1-93b1-835c53c5ded9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.111637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.124614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.132330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.133101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa361d7-7840-4ab5-9aad-da6d73c3438b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.133226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.133473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.139541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.143056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.144699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8c5df6fe-2215-4d0e-bae0-a40d9cbba91c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:08.163971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:08.165083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:08.166047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 302/617] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:08.173298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82098b-30c8-4b5c-8f8d-33c3f691bb21 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.173298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82098b-30c8-4b5c-8f8d-33c3f691bb21 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.173298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82098b-30c8-4b5c-8f8d-33c3f691bb21 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.173298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 303/618] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:08.174285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82098b-30c8-4b5c-8f8d-33c3f691bb21 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.178792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.179580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.179962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.180340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.181209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:08.181634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.183591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdad52-648e-48e9-8669-c381f07c2e4a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.196689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 316/619] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:08.198720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.199076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.206089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.220558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:08.221332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:08.291474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 317/620] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:08.292421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.305152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82098b-30c8-4b5c-8f8d-33c3f691bb21 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.351655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.352830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.353272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.353878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.355323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:08.355932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.358045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.381420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.382958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 304/621] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:08.384053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.410721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ec5c4-ec22-485b-8cd3-dc7b6d5fff10 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.437648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.456756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.457603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.457895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.458181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.472897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.474483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.495971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709b5b-59b4-4263-8a9a-86dc1d4e3940 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:08.497129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:08.498038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:08.498920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:08.498920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:08.498920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:08.498920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:08.503339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 318/622] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:08.504357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.540273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.541581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.542072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.542666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.556945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:08.566273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:08.567208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:08.568051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:08.570939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 305/623] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:08.571949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.618067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37b10-0d74-49a7-886d-2f826d4c6fee None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.656238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.661588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.662795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.663085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.663631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.677983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.680130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.681189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83973db4-8155-43be-a84f-9852f9c313d5 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.691286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:08.702239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:08.703320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:08.704930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:08.704930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:08.704930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:08.704930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:08.707069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 319/624] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:08.708031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.729506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.730474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.730957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.731946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.733100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:08.733608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.736363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.757051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 306/625] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:08.758108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.818577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc839261-9f6a-4b7f-969e-550858a8dc67 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.856365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.857178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.857594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.857975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.858832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:08.859247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.861154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.874437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 320/626] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:08.874437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.898585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dab67-c569-4591-a5aa-eee3bee240f8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.922763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:08.945584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:08.946809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:08.947256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:08.947841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:08.949527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:08.949992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:08.951631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:08.967148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 307/627] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:08.968472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:08.988158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03af504-b056-488c-afa0-cd0a9a690f6d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:08.998190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.033882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.035990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.036432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.036860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.048359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.050651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:09.069155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:09.070344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:09.071502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:09.078753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 321/628] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:09.078753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.088494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec04ba-319c-4d87-ac45-7ff013c7acfa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.136873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.138337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.139244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.139996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.156212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.158692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:09.183659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:09.184567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:09.185485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:09.185485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:09.185485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:09.185485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:09.191582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 308/629] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:09.191582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.193442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1271fca-be81-470f-acf7-6d077bedc4ff None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.196974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.232413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.233243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.233558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.233841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.241943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.243139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:09.257932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:09.258942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:09.259864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 322/630] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:09.260364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.320037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.345779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40e5b-95bd-4b21-9991-f81679f24c35 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.373671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7628f8-cf6c-4324-84de-846813b97790 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.392651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.393940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.394378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.394821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.395823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:09.396747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.398680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.412562 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.413404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.413798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.414193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.415081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:09.415554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.417017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.426931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 309/631] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:09.428095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.436828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 323/632] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:09.438767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.470509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.550384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae9ad-e77a-420a-a2ab-76a4cf5478c4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.558364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af666f9-d3ef-4eed-805f-f9385ed02c22 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.585511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.586176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.586466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.586751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.587550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:09.587883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.589331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.592502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eebd82-ab90-4515-8e44-22af7de38237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.593464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebd82-ab90-4515-8e44-22af7de38237 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.593760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebd82-ab90-4515-8e44-22af7de38237 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.594045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebd82-ab90-4515-8e44-22af7de38237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.596455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.601635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 310/633] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:09.602429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.662041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eebd82-ab90-4515-8e44-22af7de38237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.663591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eebd82-ab90-4515-8e44-22af7de38237 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.687660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.701964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fdd6c-ad01-439f-8968-2977ec901a9d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.736393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.737184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.737510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.737791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.745259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.746740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-81333ecf-09e2-4c1e-a950-65c388ea0551 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:09.761326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:09.762485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:09.763416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 311/634] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:09.764668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 324/635] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:09.764982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565216d-af35-4908-a312-0d33a74d74b5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.765251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94eea-1d4e-46a0-9341-c42f86736ee7 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.765588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94eea-1d4e-46a0-9341-c42f86736ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.765874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94eea-1d4e-46a0-9341-c42f86736ee7 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.766132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565216d-af35-4908-a312-0d33a74d74b5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.767168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565216d-af35-4908-a312-0d33a74d74b5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.768004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 325/636] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:09.768502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94eea-1d4e-46a0-9341-c42f86736ee7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.769807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 312/637] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:09.770824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565216d-af35-4908-a312-0d33a74d74b5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:09.834127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.873486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94eea-1d4e-46a0-9341-c42f86736ee7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.877308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565216d-af35-4908-a312-0d33a74d74b5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:09.896901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:09.911830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff644d1-68b5-4f88-abc3-fdd9e68f97fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.913108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff644d1-68b5-4f88-abc3-fdd9e68f97fd None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.913613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff644d1-68b5-4f88-abc3-fdd9e68f97fd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.914601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff644d1-68b5-4f88-abc3-fdd9e68f97fd None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/4f3bfddef4664aad9d210fbeb52acda9/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.914703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:09.915290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:09.915763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:09.916237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:09.917720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:09.918224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.920242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.937503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff644d1-68b5-4f88-abc3-fdd9e68f97fd None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=4f3bfddef4664aad9d210fbeb52acda9, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:09.940746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff644d1-68b5-4f88-abc3-fdd9e68f97fd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:09.948437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 313/638] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:09.949322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.047345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a1f30-0981-4679-b421-0fe085a532c4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.058807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 326/639] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:09 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/4f3bfddef4664aad9d210fbeb52acda9/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:10.060185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.060484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.060766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.072156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.092517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.092963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:10.093642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.093936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.094219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.095437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:10.105871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:10.107383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e71714af-276c-4090-8f60-cee6e7939f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:10.129765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:10.130734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:10.131605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:10.131605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:10.131605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:10.131605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:10.131605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 314/640] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:10.132919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.132919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.132919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.150924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:10.152144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:10.189442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 327/641] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:10.189442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.238250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 315/642] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:10.239025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.319727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d613bd-ef3a-4241-a1b7-53f9df763c4b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.322888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.357502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.358168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.358456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.358582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.358747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.363157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881ec99-0bed-4086-ae85-e7f1f80df79a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.398011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.398685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.398976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.399254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.399983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:10.400297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:10.401713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:10.413760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 316/643] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:10.414734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.437474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:10.439981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:10.517538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a786d95-ff30-41ec-a547-f1eea09d81ad None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.554753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 328/644] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:10.555815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.556492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.557336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.557630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.557916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.559243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.572344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:10.581004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:10.582549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:10.583611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 317/645] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:10.584502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.620206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.681090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a437-b8a5-407b-bbb5-f964d51e0948 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.705150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c18f-7ea8-42f5-a4dd-69ccc97db519 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.716691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.717573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.717864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.718428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.729757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:10.738242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:10.739167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:10.740133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 329/646] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:10.740845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.746802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.747607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.747900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.748188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.755981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:10.757611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:10.773958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:10.774867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:10.775745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 318/647] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:10.776221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.807656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.847399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f32f0-fe88-4b8c-9108-6497c3b05213 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.863143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:10.886094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813d213-788f-4b51-ae83-6fcd2615e161 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:10.886296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.886993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.887318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.887600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.899019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:10.900491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:10.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:10.918488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:10.919380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:10.919380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:10.919380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:10.919380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:10.919380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 330/648] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:10.919670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:10.930724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:10.931434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:10.931958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:10.932111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:10.932727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:10.933037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:10.934507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:10.947953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 319/649] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:10.947953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.025155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea08beb-81f7-491f-840a-f3fce79ec588 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.042262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.059758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892de33-cd8b-468b-b2e1-2ee89fba23b6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.060034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.060672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.060959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.061244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.062018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.062324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.064215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.077200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 331/650] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.077200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.102403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.103075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.103367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.103645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.104466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.104781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.106254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.116383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.119693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 320/651] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.122334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.184440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dda80-73d8-45a5-88c3-20b6e1eae111 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.221187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.222165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.222448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.222722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.223455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.223750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.225254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.241590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 332/652] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.241590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.244454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec73a-4576-412b-a5d2-bd8815e4cc43 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.285692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.293452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.294255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.294727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.295015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.308650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.310140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:11.328490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:11.338082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:11.339236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:11.339236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:11.339236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:11.339236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:11.339236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 321/653] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:11.339236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.360503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440572f-f7bf-4096-8c84-6dad7b1077f5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.397054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.397960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.398417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.398766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.400238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.412184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.413757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:11.431597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:11.432778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:11.434120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:11.434120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:11.434120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:11.434120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:11.437447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 333/654] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:11.438861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.455523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce03f2-316a-4b68-b0c3-7feecff71684 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.496593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.497250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.497571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.497848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.498672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=9687c85240694148aa572d8807ada25b) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.498982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.500421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.506935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 322/655] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/role_assignments?user.id=9687c85240694148aa572d8807ada25b&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.507722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.560550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.575957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b78ca-e6e6-4081-89b8-1be4d14d0724 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.634102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.635987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.636441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.636875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.645185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2beb1a-d414-4298-8fb7-9a78d55bdbf7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.649655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.651490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.665675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:11.674765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:11.676858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:11.677757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:11.701971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 334/656] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:11.701971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.702126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.702126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.702126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.702126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.702383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.702383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.702383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.710384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 323/657] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.710384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.834385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7089-fb80-4884-bcea-3ef0510fb76c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.852110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe1ba-b412-4ffd-8c93-358a49994587 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:11.870008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.870681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.870968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.871249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.871976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.872288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.873692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.887145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 335/658] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.887973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.892192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:11.893909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:11.894433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:11.894852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:11.895791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:11.896268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:11.897916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:11.900879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.912509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 324/659] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:11.913307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:11.957633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:11.993961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cd1c6-6de7-4d9e-b123-efccfa895d37 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.030254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2f2d-0bf7-43e5-b1fc-1f4f5b190bcc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.031881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.032897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.033365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.033819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.041623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.043266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:12.058942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:12.060120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:29:12.061191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:12.067717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 336/660] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:12.068830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.070350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.071272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.071272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.071458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.080791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.082346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:12.099821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:12.100967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:12.101985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 325/661] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:12.102587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.149445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:12.181804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432312e-a3c4-4d56-b09a-dbdda4f29ab2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.208153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:12.215185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad779cc-0f9c-4d31-8bdb-ce1ca60fa816 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.219006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.220265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.220787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.220787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.221665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=1eee79db5d38448fb7e3c40be668a3cc) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:12.221990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.226081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.229556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 337/662] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/role_assignments?user.id=1eee79db5d38448fb7e3c40be668a3cc&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:12.230280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.268943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.270086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.270590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.271063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.272115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:12.273308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.275859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aa000-7b79-443b-81f9-34167ade5460 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.305322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 326/663] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:12.307171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a41149-a0c9-4c5e-ba46-d49f2d7f5765 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.307648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a41149-a0c9-4c5e-ba46-d49f2d7f5765 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.308092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a41149-a0c9-4c5e-ba46-d49f2d7f5765 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.310197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 327/664] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:12.311376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a41149-a0c9-4c5e-ba46-d49f2d7f5765 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.394574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65d0d-1de1-45e6-9fc6-8d3ef90977f6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.444836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.446040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.446339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.447278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.447620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:12.447939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.449486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee981e-c056-4ef7-8f31-b9925ebe37a2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.450301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a41149-a0c9-4c5e-ba46-d49f2d7f5765 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.452569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:12.471793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 338/665] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:12.473210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.474375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.474375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.493555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:12.495087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:12.506145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.508686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.508686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.509115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.537979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:12.585326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 339/666] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:12.585326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.606072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.607803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.708427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9347bf-0373-4b58-b8ef-9cb9b23b4240 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.721880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 328/667] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:29:12.722835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.734430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:12.747646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.748678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.749171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.749682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.786191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:12.836515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:12.837405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fb21d-fc15-4a54-ae45-8bc66fadeaf3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:12.838609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:12.873093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:12.873968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:12.874255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:12.874535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:12.886223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:12.894275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:12.895209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:12.896031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:12.900407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 329/668] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:12.901289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.955546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 340/669] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:12.956794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:12.982722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.010057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b397d4e-8bb3-483b-b739-452420084504 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.025309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.046273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.047095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.047597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.047889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.058634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.060113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.071577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00c91f-d719-43e4-8577-1083db263682 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:13.078339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:13.079867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:13.080763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:13.080763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:13.080763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:13.080763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:13.084846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 330/670] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:13.085752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.115461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.116512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.117073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.117701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.118656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:13.119216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.121408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.131916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 341/671] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:13.133190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.199127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303660fe-c035-43a5-b943-1e90e1cd986f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.233976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.234695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.235015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.235296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.237717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.246691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.248180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.256299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde16d14-c8b4-488b-b9b9-ce1f9a99cf41 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:13.278245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:13.279117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:13.279988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:13.279988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:13.279988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:13.279988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:13.284245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 331/672] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:13.285121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.298682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.299614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.300041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.300460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.305093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:13.305093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.305093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.306047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.319560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 342/673] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:13.320690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.398977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a12514-654e-4ce1-b20c-6d9807560217 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.434414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.435136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.435427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.435706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.437260 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c5b97-cf38-48cd-8b86-874763f2bf23 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.448344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.449892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:13.470710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:13.472068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:13.473217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:13.473217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:13.473217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:13.473217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:13.476905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 332/674] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:13.478101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.480739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.481997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.483393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.483890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.484964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:13.485506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.487107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.503849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 343/675] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:13.505042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.539844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.564696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.602016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a92e9-5ecd-43a0-bb93-b76dfa5bac09 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.638764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd5f4c-e6c1-403f-b0f7-3ad48770c7d4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.641088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.642566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.643003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.643444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.650700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.652343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:13.667518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:13.668456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:13.669390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:13.674552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 333/676] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:13.675436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.681778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.682683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.683174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.683629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.685057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:13.685586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.688083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.709393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 344/677] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:13.710279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.779453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.790662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac307a40-c2ee-473d-b892-bbd4ff942d38 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.821883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8e19-ccbf-4500-ab3a-78ca14356e6e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.825112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:13.831792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.832618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.832882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.833164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.840272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.841664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:13.857208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:13.858192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:13.859058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 334/678] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:13.860364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.865943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:13.866637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.866938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.867223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.868028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:13.868345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:13.869853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c043a9-28cf-4378-997c-392532b16875 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:13.883092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 345/679] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:13.884515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50bfb-e9d3-46da-9cf4-49c3f15f51e0 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:13.884808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50bfb-e9d3-46da-9cf4-49c3f15f51e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:13.885088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac50bfb-e9d3-46da-9cf4-49c3f15f51e0 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:13.886519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 346/680] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:13.889996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac50bfb-e9d3-46da-9cf4-49c3f15f51e0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:13.973832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd41f74-b09b-46ce-aa1a-917bdc645a01 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:13.997687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac50bfb-e9d3-46da-9cf4-49c3f15f51e0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.015613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.019360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.019360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.019360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.027057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.029753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.031090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.039359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.042932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.042932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.042932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.042932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:14.042932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.043439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce5596-a1b9-44a0-94b5-b33673d9c321 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:14.046582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:14.047820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 335/681] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:14.049554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.065694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 347/682] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:14.065694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.065694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.065694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.081659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:14.082855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:14.110597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.154902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 348/683] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:14.156040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.177333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4f5c-adff-4a85-8228-16ce7b6138fa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.216147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.216809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.217099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.217421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.218724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=8f5efc58077843358aeb93e42997f2c3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:14.218831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.220564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.237315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 336/684] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/role_assignments?user.id=8f5efc58077843358aeb93e42997f2c3&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:14.237315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.288598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9744a8-d79a-4d08-8806-374b982a19d3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.308447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.332447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.333135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.333475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.333760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.334619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:14.334936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.336581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.360674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 349/685] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:14.363066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.395706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138fe92-635c-40ae-b130-48989f575386 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.411900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.439416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.440334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.440806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.441238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.442301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=1097be6c3ab44dd1a3532926235e980c) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:14.442768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.444438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.451207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 337/686] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/role_assignments?user.id=1097be6c3ab44dd1a3532926235e980c&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:14.452229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.495264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4731d70-2040-4cbb-a861-cde8eb6b721a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.546340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6abb0b-cf62-41a6-8241-998d1189b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.548516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6abb0b-cf62-41a6-8241-998d1189b280 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.549044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6abb0b-cf62-41a6-8241-998d1189b280 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.549692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6abb0b-cf62-41a6-8241-998d1189b280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.564779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6abb0b-cf62-41a6-8241-998d1189b280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-da6abb0b-cf62-41a6-8241-998d1189b280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:14.572859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:14.573896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:14.574739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 350/687] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:14.577651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07920ae9-c39d-45fa-ad57-a0e65731b710 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.577651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07920ae9-c39d-45fa-ad57-a0e65731b710 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.577651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07920ae9-c39d-45fa-ad57-a0e65731b710 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.579408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 351/688] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:14.586658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.587091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.587381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.589192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109642c-a7cc-4f27-aea5-89c5fcf85b24 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.611472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:14.613760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:14.635539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.636382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.637157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.637157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.651615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.700597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.706461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 352/689] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:14.707622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.735913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.737656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.845097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203e76-880d-450b-a59a-c75da9588ead None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:14.848775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 338/690] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:14.849731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.887626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:14.888306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:14.888598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:14.888882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:14.889682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:14.890002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:14.891546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:14.901603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 353/691] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:14.902432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:14.933099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.952565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:14.981233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f32d9-7ae0-46bf-a30c-bb59aeb8b0dc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.016990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8671-cce6-4240-8f9b-cf239d45ad61 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.022725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.023638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.023995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.024354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.036630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.038335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:15.058874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:15.059839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:15.060723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:15.060723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:15.060723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:15.060723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:15.065325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 339/692] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:15.066204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.066918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.068070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.068566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.069044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.081383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.083213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:15.102175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:15.103147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:15.104133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:15.104133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:15.104133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:15.104133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:15.108038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 354/693] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:15.108996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.188675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c055-35ea-4728-9bd2-f3927264c306 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.200469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:15.226857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068332a-07a2-4c13-acdb-2c3961a28ca8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.234969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:15.246242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.247771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.248251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.248696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.263868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.265704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.275542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.276777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.276777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.277187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.278080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:15.278490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.280226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:15.290970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:15.291937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:15.292818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:15.292818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:15.292818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:15.292818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:15.295532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 340/694] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:15.296457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.302039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 355/695] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:15.303119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.429895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a1e76-5966-42f3-b657-8a1abde47581 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.430428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eb008-a5ae-4704-bd71-4de4ce012ecd None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.467056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.468162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.468551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.468975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.470004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:15.470243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.471849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.475582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.476413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.476865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.477310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.478173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:15.478625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.480591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.483898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:15.489747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 341/696] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:15.489747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.499664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 356/697] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:15.501642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.548483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:15.620911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763142e7-d8ab-4840-abb4-1dcf82566c6a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.630196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b2d7-5512-42a6-ac3e-2763269f77a1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.657035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.657865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.658155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.658447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.668420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.670803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.674648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.675327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.675614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.675897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.676611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.678079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:15.690107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:15.691116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:15.692046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 357/698] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:15.692589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.752136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:15.801901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 342/699] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:29:15 2022] POST /identity/v3/users => generated 254 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:15.803035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.811159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491f4dc-535f-47ae-b9a7-d26665d3dbf4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.893633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:15.894743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:15.895189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:15.895669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:15.911545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:15.916650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:15.943125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:15.944291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:15.945508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:15.954061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 358/700] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:15.959480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:15.973659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f932ac4-876c-4dc5-b6e4-ed515b2169c0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:15.981930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:16.015678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.016686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.017613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.018009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.019070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:16.019490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.021107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.036699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 343/701] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:16.045179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:16.135244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbafaf6-9590-4859-a219-66b2abdad0e0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:16.159411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:16.173317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193412f-08ba-4e14-8799-fe76a400b925 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:16.183962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.185115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.185434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.185722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.187181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:16.188195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.189958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.216247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 359/702] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:29:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:16.221810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.222488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.222777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.223060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.223612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:16.223910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=4f3bfddef4664aad9d210fbeb52acda9) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:16.224229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.225793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.235870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 344/703] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:16 2022] GET /identity/v3/role_assignments?user.id=4f3bfddef4664aad9d210fbeb52acda9&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:16.349618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577e5da-8dfd-485f-83e5-79feea78eaa3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:16.388812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b48159-228f-4327-a78a-6ff8c6027506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.389629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48159-228f-4327-a78a-6ff8c6027506 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.389954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48159-228f-4327-a78a-6ff8c6027506 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.390309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48159-228f-4327-a78a-6ff8c6027506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.440217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:16.467197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b48159-228f-4327-a78a-6ff8c6027506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.468981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b48159-228f-4327-a78a-6ff8c6027506 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.576277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 360/704] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:16.582022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:16.587149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67620f-2f6b-4d04-b792-77e7ebbebc83 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.587450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67620f-2f6b-4d04-b792-77e7ebbebc83 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.588691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67620f-2f6b-4d04-b792-77e7ebbebc83 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.590445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 361/705] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:16.598350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.598737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.599094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.615744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:16.622937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:16.624432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:16.703882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db084f4-4ee6-4368-8306-6b0fddae3357 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:16.717414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 362/706] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:16.737701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:16.740914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:16.752824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.753912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.756335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.756335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.768486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.770023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2499e006-f883-4448-b3f0-78ede8e452f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:16.790839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:16.791781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:16.793362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:16.793362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:16.793362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:16.793362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:16.793362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 345/707] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:16.793674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c294-5a1f-4fd4-88f7-3e0c4a095e1a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.793931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c294-5a1f-4fd4-88f7-3e0c4a095e1a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.794228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c294-5a1f-4fd4-88f7-3e0c4a095e1a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.795671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 346/708] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:16.799324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c294-5a1f-4fd4-88f7-3e0c4a095e1a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:16.880809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd4802-07f5-4e36-b562-08efae523b28 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:16.888294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:16.916600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c294-5a1f-4fd4-88f7-3e0c4a095e1a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:16.925990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.927046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.927507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.927951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.929252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.931305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-04dc0dc6-a3f2-4a52-9137-b4ccec369b4f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:16.950776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:16.952043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:16.953181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:16.956637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 363/709] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Jun 21 16:29:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:16.958177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.958623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.959037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.965597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:16.967043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:16.967043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:16.967043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:16.968287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:16.968635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:16.971517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:16.981492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:16.983274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:16.989371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 347/710] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:16.989371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.071535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:17.085301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 364/711] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:17.085301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.136740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4732e-a111-431a-98f7-1b55f0df0e91 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.180865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.181728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.182084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.182426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.183204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:17.183581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.185573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.186892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:17.197366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 348/712] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Jun 21 16:29:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:17.198442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.216254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f4ad-5743-4d83-b069-91b5993c1825 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.256106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.257513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.258012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.258525 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.273061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.275107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:17.292085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:17.293044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:17.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:17.301844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 365/713] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:17.307548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.327377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccc806-ae30-4206-9655-1fcda3cb7ecf None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.371928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:17.375530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.376800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.377087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.377389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] PATH_INFO: `/v3/services/network` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.378373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.380064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:17.398646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:17.399718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:17.400553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:17.407935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 349/714] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:17.409101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.434762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def6c2e-8f21-4e59-b666-33c7d92577d3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.480729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.482113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.482599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.483308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.484765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:17.485675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.487854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.490037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:17.496923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 366/715] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:17.498002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.588753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3264d14-6a03-4b36-a617-fc769c104a08 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.627021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc9a63-69a7-47b2-aef7-ceda0c7fa63e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.655931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:17.671256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.676756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.676756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.676756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.676756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:17.676756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.676756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.682343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 367/716] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:17.689057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.693325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.694022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.694422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.694805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.695716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:17.696138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.697774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.727726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 350/717] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:17.733615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:17.820234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e518c31-ca68-45a8-bf11-77bbb802ebd2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.868002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.868830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.869137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.869807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.870669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] RBAC: Adding query filter params (type=network) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:17.870981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.872506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891438ae-a8ec-4ff4-928f-b08d410f0cfa None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.873306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a5405-4778-40c1-8aa9-8e34ce0afc5a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:17.885392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 368/718] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:17.907323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:17.917690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:17.918368 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:17.918659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:17.922679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:17.922679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=9687c85240694148aa572d8807ada25b) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:17.922679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:17.922679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947a5ea-4234-4acf-858e-a8aa4463b7f9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:17.932813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 351/719] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:17 2022] GET /identity/v3/role_assignments?user.id=9687c85240694148aa572d8807ada25b&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:18.407944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5d36-199b-46a3-a8a7-915b18256097 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:18.408327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5d36-199b-46a3-a8a7-915b18256097 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:18.408554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5d36-199b-46a3-a8a7-915b18256097 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:18.410495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 369/720] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:18.416119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6699e8-effa-4bf7-9d76-30e3f3733394 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:18.416607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6699e8-effa-4bf7-9d76-30e3f3733394 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:18.416687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6699e8-effa-4bf7-9d76-30e3f3733394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:18.435240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5d6699e8-effa-4bf7-9d76-30e3f3733394 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:18.436440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5d6699e8-effa-4bf7-9d76-30e3f3733394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:18.535660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 352/721] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:18.571975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5d36-199b-46a3-a8a7-915b18256097 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:18.748078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:18.807097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef606d8-ad8a-46e9-975d-ebd72acb824b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:18.807724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef606d8-ad8a-46e9-975d-ebd72acb824b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:18.808207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef606d8-ad8a-46e9-975d-ebd72acb824b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:18.810132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 353/722] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:18.815648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cfb50-416c-413e-88c0-683361651084 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:18.816220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cfb50-416c-413e-88c0-683361651084 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:18.816706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cfb50-416c-413e-88c0-683361651084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:18.825015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e5d36-199b-46a3-a8a7-915b18256097 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:18.837107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-980cfb50-416c-413e-88c0-683361651084 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:18.838664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-980cfb50-416c-413e-88c0-683361651084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:18.902822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:18.905419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:18.905940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:18.907859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:18.928606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:18.937449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:18.938411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:18.939296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:18.951304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 354/724] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 16:29:18.951612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 370/724] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:18.958553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cfb50-416c-413e-88c0-683361651084 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.005548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.028492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:19.124345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cfb50-416c-413e-88c0-683361651084 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:19.139871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d95c-a748-46ca-9b0c-19e0abacb3b5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:19.159497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:19.192209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:19.193342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:19.194541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:19.196451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:19.197463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:19.198147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:19.200582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:19.208821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:19.209979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:19.210488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:19.210972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:19.215872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 355/725] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:19.217461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.238427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:19.246676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:19.247777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:19.248641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:19.275935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 371/726] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:19.281854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.427212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be860-a4dd-40c5-862c-0c787534ec80 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:19.447915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:19.487207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637d6c-e7df-4c0c-ae37-6278bdaf5052 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:19.493921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:19.499424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:19.500520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:19.501016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:19.518720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:19.520617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:19.548552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:19.549502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:19.550392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:19.550392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:19.550392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:19.550392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:19.557996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:19.558930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:19.559421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:19.559922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:19.560882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:19.561426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:19.563582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:19.566036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 356/727] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:19.572377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.587175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 372/728] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:19.598006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.649303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:19.751842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5705-86a9-4665-8bc7-ee582a9b4a10 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:19.767475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6148-d914-4307-90ad-d18cf37b418b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:19.806011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:19.807197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:19.807759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:19.808240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:19.829169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:19.830681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:19.832380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:19.833258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:19.833771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:19.834277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:19.835649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:19.836335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:19.839108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:19.858618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 357/729] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:19.865000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:19.869690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:19.870591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:19.871513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:19.871513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:19.871513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:19.871513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:19.876213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 373/730] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:19.881866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:19.897727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:19.975538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb64b38-66a6-4ca3-988d-9f3c6b41f8ca None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.012495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.013679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.014173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.014678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.022621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.024415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:20.041721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:20.042724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:20.043655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:20.046315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 358/731] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:20.052479 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:20.111647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.157354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92879-763b-4089-91f8-725fb9347f03 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.166602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e1c7-0f22-4edc-9cc4-cc992c95d89d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.181687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.203779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.204467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.204781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.205067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.205839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:20.206149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.209248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.227618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.228299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.228589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.228868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.229750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:20.230119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.233368 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.247250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 374/732] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:20.248800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:20.280251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 359/733] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Jun 21 16:29:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:20.281927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:20.385840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67f011-ad97-4bd5-928d-55690cbb2c03 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.411357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95376f-ae2b-469a-aceb-35b1352088a5 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.424157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.424958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.425245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.425650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.433848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.435310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.447708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837dc03-495e-495e-a2df-16fccf4f062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.448364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837dc03-495e-495e-a2df-16fccf4f062e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.448645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837dc03-495e-495e-a2df-16fccf4f062e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.448927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837dc03-495e-495e-a2df-16fccf4f062e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d6b4e93f-f1a8-43f9-8a54-237b4fcbcaf1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:20.452170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:20.453677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:20.455664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 375/734] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:20.457051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43eb2a-aed5-4bb2-915d-e2d0f7f2b2b0 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.457051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43eb2a-aed5-4bb2-915d-e2d0f7f2b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.457051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43eb2a-aed5-4bb2-915d-e2d0f7f2b2b0 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.465302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 376/735] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:20.465302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105675e0-6615-4cce-a4f5-5ade5b1d37f6 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.465302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105675e0-6615-4cce-a4f5-5ade5b1d37f6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.465866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.466024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105675e0-6615-4cce-a4f5-5ade5b1d37f6 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.466024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 377/736] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:20.466506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.467000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.467485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.475908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.486623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:20.487879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:20.524447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837dc03-495e-495e-a2df-16fccf4f062e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.525872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837dc03-495e-495e-a2df-16fccf4f062e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.553301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 378/737] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:20.554174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:20.628706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 360/738] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 16:29:20.630055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9430283-20d9-47af-9682-d01364877198 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.630350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9430283-20d9-47af-9682-d01364877198 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.630629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9430283-20d9-47af-9682-d01364877198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.647028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a9430283-20d9-47af-9682-d01364877198 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:20.648233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a9430283-20d9-47af-9682-d01364877198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:20.661355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beac1f-4067-4fe1-82c0-41fcbe6f2854 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.677627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.695650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.696322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.696613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.696896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.697767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:20.698085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.699515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.701325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.714806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 361/739] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:20.716662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c170c-e4b4-428a-9236-64e093f907aa None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.716940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c170c-e4b4-428a-9236-64e093f907aa None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.717220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c170c-e4b4-428a-9236-64e093f907aa None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.718825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 362/740] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:20.719504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c170c-e4b4-428a-9236-64e093f907aa None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:20.727397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 379/741] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Jun 21 16:29:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:20.728472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:20.828552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c170c-e4b4-428a-9236-64e093f907aa None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.832403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427789-ba75-4f66-9cc0-53a7c65e4d36 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:20.864132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.864796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.865084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.865426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.866150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.866564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:20.867348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.867563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.867675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.867893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.878375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:20.879794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-93542c42-2567-4391-8113-126a24e823e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:20.897890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:20.898957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:20.899969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:20.899969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:20.899969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:20.899969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:20.899969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 380/742] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:20.900270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:20.900475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:20.900751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:20.916543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:20.917760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:20.956953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:20.979585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 363/743] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:20 2022] POST /identity/v3/services => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:20.980405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.004619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 381/744] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:20 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 16:29:21.005513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.019902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.103495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5cb16-e81c-4d2c-acd9-3512f3dc9ae7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.132737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820377ce-1a51-4d13-8ddd-ae87b145030f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.144536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.145102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.145440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.145726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.172028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.172723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.173054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.173489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.174228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.175614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.217932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.219569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.246784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.249233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 382/745] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:21 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:21.251157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.296362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.373407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 364/746] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:20 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 16:29:21.373407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.393082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83288d6-32fa-47d9-b689-54f8b41b4ec3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.446353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.447301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.447592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.447875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.448771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:21.449437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.450830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.466010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 383/747] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:21.467315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.508185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2504-ff0e-4a69-82d3-af8d18f8993c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.545809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.553746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.554960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.555904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.556402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.571406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:21.580417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:21.582209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:21.583107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:21.584027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:21.587123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 365/748] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:21.588240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.599914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c60b0-d7dd-4d43-b6f2-bc2db5e4b802 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.641385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.642362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.642745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.643124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.654917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.657361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:21.676899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:21.678015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:21.678905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:21.678905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:21.678905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:21.678905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:21.679454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 384/749] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:21.680840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.707020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e658-a21a-49a7-baaf-5a5e60a5c442 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.751852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.753109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.753693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.753982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.763208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.766639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:21.784973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:21.787047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 366/750] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:21.788900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.805356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563015-0144-4e0b-b33c-f98dd79a293d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.849840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.850523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.850815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.851102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.852020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:21.852332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.854404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.855362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.861450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:21.869440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 385/751] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:21.874079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:21.928422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14909fb5-a203-4d7e-a465-77c79120d259 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.976936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:21.977875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:21.978159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:21.978439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:21.979163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:21.979581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:21.979733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e758d-65c3-4355-b376-b55f3dc16c9d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:21.980999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:21.997546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 367/752] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:21.998502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.022045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.022712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.023058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.023400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.024242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:22.024556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.026089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.040178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 386/753] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:22.040991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.124232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:22.126820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8354a1-2fba-44d2-86b1-882b587cb935 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.136299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:22.164492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.165423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.165790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.166182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.172884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410bc0-4c4d-4381-8649-9b889efa6ed5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.178178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.180002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:22.199753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:22.201851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:22.204691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:22.204691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:22.204691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:22.204691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:22.204691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 368/754] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:22.204691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.209836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.210637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.210920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.211196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.219541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.220713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:22.238140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:22.240159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 387/755] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:22.242282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.316737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8d944-4077-4738-82c8-c8c7fff3f7dd None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.354505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.355248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.355540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.355770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b65d9-2db3-4d04-b75b-098582d4f5ab None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.355922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.356650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=2d8f0f57e4e8406dbab4cbcbe9836267) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:22.356971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.358655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.365595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 369/756] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/role_assignments?user.id=2d8f0f57e4e8406dbab4cbcbe9836267&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:22.366415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.392215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:22.397307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:22.425655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.426445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.426740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.429681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.430495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:22.430751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.432140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.460055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 388/757] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:22.461399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.487338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f18f-6353-4759-852e-1aafe947194c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.527212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.527989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.528174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.528459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.529297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:22.529619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.531698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.547993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 370/758] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:22.553640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.661524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cc50f-52cd-4783-9337-cbda9a5234b8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.715125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:22.729240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.734565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.734565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.734565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.735388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4dcf9-3f22-493b-a847-2af61c72d8a4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.754498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.755971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:22.781763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:22.782756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:22.783674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 389/759] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:22.786830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.787674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.788657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:22.789389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.790132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.792957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=4f3bfddef4664aad9d210fbeb52acda9) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:22.793431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.795886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:22.810332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 371/760] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/role_assignments?user.id=4f3bfddef4664aad9d210fbeb52acda9&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:22.866244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:22.929056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad0b5b-3588-4568-a98a-12d50e86edc5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:22.982442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:22.983041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:22.983331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:22.983614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:22.985461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:22.985461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:22.986818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:23.015698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 390/761] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:29:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:23.021090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:23.179131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b9d53-901d-40bf-9e17-89bcb4f6e704 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:23.225875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:23.226687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.226974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.227253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.241220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:23.242652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:23.256410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b6b60dae-0f24-4931-a3b2-64d18e6ce45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:23.267689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:23.273900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:23.274785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:23.274785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:23.274785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:23.274785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:23.274785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 372/762] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:23.275054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:23.289997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b1ba-c8dc-44c7-9873-fa7b59917217 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.290616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b1ba-c8dc-44c7-9873-fa7b59917217 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.291110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b1ba-c8dc-44c7-9873-fa7b59917217 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.297020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 373/763] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:23.299112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.305889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.305889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.318059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:23.319580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:23.448218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 374/764] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:23.457444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06f04b-fa15-4c86-9e61-f9a2455b866a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:23.469659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:23.501329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:23.521172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:23.522456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.523721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.525627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.526571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:23.528399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:23.530280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:23.548628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 391/765] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:23.554066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:23.675898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613f0bf-7764-4e78-be55-38435e1fa4c7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:23.714406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277253ca-a761-4fd9-8ab5-d82c60f12bdf None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:23.716741 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:23.727204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:23.728866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.728975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.729391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.730072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:23.731752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7425e77d-4890-4f0f-8cb6-12fc2d8ab8e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:23.748259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:23.749272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:23.752386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:23.755529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 375/766] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:23.757447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efda1f-c42d-4b95-8ae9-0ba04f150d7d None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.757736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efda1f-c42d-4b95-8ae9-0ba04f150d7d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.758014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efda1f-c42d-4b95-8ae9-0ba04f150d7d None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.761092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:23.762154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.762651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.763124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.763508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 376/767] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:23.765876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.766667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.766667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.773307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:23.775148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:23.787929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:23.789141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:23.792843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:23.793912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:23.794812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:23.797941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 392/768] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:23.799022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:23.819865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:23.885426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 377/769] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:23.886724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:23.923669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbd4e-d7a1-45f2-b92e-79b606935909 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:23.963101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:23.964139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:23.964654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:23.965135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:23.966078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] RBAC: Adding query filter params (name=network) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:23.966620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:23.968476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:23.973620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 393/770] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:23.974711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.033820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898477-e342-4252-91b4-76f36d88f657 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.059733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:24.067495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:24.073254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.074287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.074287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.074475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.075271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:24.075584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.077027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.087145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5509959-4862-419d-bcb0-802976d5790d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.090251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 378/771] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.090631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.126230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.127429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.127926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.128414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.129377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.131043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:24.145209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:24.146291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:24.147124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:24.150093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 394/772] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Jun 21 16:29:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:24.151119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.217129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90142af3-9b07-4727-9bbb-10c62c179375 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.256617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d2ea-fe08-426a-9a48-891eddf2dc74 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.260103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.260784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.261072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.261378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.262096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] RBAC: Adding query filter params (type=network) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:24.262407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.263885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.281319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 379/773] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.281319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.305596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.306856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.307425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.308019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/9687c85240694148aa572d8807ada25b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.310364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=9687c85240694148aa572d8807ada25b, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.312724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.332948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:24.384045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ce706-9b85-434d-8776-d83e81395d85 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.417229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.417920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.418208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.418490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.419201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:24.419513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.421054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.429310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 380/774] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.430000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.432565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 395/775] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:24 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/9687c85240694148aa572d8807ada25b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:24.443074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.459266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:24.635237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a196a-bf3f-463c-88b7-c9cea2468614 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.651100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:24.654627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1304e3-6173-46aa-a4c6-ba41dbe39f34 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.675521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.676658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.677616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.678132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.679280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] RBAC: Adding query filter params (interface=public, service_id=490bf064e1fa4322b0b477dff99cc0d6, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:24.679925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.681563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.692414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.692907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 381/776] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/endpoints?service_id=490bf064e1fa4322b0b477dff99cc0d6&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.693017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.696066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.696066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.696066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:24.696066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.696066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.699422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.703446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 396/777] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.708988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.784011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:24.817648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c989-0bd0-4524-a868-945db090dfbb None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.843681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a641ae-1baa-43f7-a329-fa57d7223ad3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:24.866102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.867386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.868019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.868521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.870078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] RBAC: Adding query filter params (interface=public, service_id=2aebd8534600403abf7a5ae477d1948b, region_id=RegionOne) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:24.870571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.873077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7cf52-67f9-4124-8f60-e0b39b471a29 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.880461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fcf7-e614-4ce9-ba65-eaa82190cb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:24.881110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fcf7-e614-4ce9-ba65-eaa82190cb85 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.881493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fcf7-e614-4ce9-ba65-eaa82190cb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.881867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fcf7-e614-4ce9-ba65-eaa82190cb85 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.882627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fcf7-e614-4ce9-ba65-eaa82190cb85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:24.884091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fcf7-e614-4ce9-ba65-eaa82190cb85 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:24.885043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 397/778] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/endpoints?service_id=2aebd8534600403abf7a5ae477d1948b&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.887018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aadec4-f11a-44a4-ab9e-ef820fc4ee03 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.887728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aadec4-f11a-44a4-ab9e-ef820fc4ee03 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.888183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aadec4-f11a-44a4-ab9e-ef820fc4ee03 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.889965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 398/779] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:24.890398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 382/780] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:24.891276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aadec4-f11a-44a4-ab9e-ef820fc4ee03 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:24.898970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688e2e-3055-45fd-9c4e-992f21b6de9a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:24.899319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688e2e-3055-45fd-9c4e-992f21b6de9a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:24.899675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688e2e-3055-45fd-9c4e-992f21b6de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:24.942461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-70688e2e-3055-45fd-9c4e-992f21b6de9a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:24.943809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-70688e2e-3055-45fd-9c4e-992f21b6de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:25.018037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aadec4-f11a-44a4-ab9e-ef820fc4ee03 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:25.032075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:25.063688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:25.064441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.064725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.065002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.065746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:25.067825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:25.069327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:25.075938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 399/781] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:24 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:25.085270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 383/782] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:25.111428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.213595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03b4f0-c085-4aab-9a50-16bb16b99671 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.214163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03b4f0-c085-4aab-9a50-16bb16b99671 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.216068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03b4f0-c085-4aab-9a50-16bb16b99671 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.218906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 384/783] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:25.224942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.225546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.226031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.248265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b12a8b-231c-43a9-9912-5d61fe2a988e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:25.274474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:25.275777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:25.294841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:25.297094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.297585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.298035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.313180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:25.325156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:25.326152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:25.327144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:25.330496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 400/784] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:25.336662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.380627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 385/785] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:25.407017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.418434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:25.468500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1179-e651-418a-9e4a-1d28a6ba0fe0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:25.506806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:25.507732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.508164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.508588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.509675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:25.510262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:25.511825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:25.522853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 401/786] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:25.526861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.545149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:25.551136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686f4b8-85c4-421e-8415-631a809d959e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:25.625312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:25.626176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.626494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.626777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.653529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:25.666582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:25.667597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:25.668418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:25.678848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 386/787] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:25.690446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.742817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3084-dc62-4d42-97fc-7ebecc8c6280 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:25.784135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:25.818791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:25.819596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.819882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.820163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.841332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:25.843924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:25.860195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cbd38-69ff-426b-bae9-0767d66ce8a0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:25.872068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:25.873165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:25.874401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:25.874401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:25.874401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:25.874401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:25.874401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 402/788] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:25.879206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.903888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:25.904567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:25.905018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:25.905329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:25.906950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:25.906950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:25.908367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:25.925776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 387/789] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:25.931765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:25.971915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:26.062865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efca2e0-2ad2-4b6a-b1ba-8b89e5cf609b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.097868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.099261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.099820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.100113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.111609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.113188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.124037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f44b5-004e-4c3b-8c26-9e1ccb6d52f4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:26.131117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:26.132044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:26.132920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:26.132920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:26.132920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:26.132920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:26.132920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 388/790] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:26.138670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:26.222021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.222711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.222998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.223283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.224027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:26.224341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.225751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.236027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:26.238719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 403/791] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:26.246227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:26.260547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f797d51-d217-4317-a080-1a86fab5036c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.299141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.302395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.302395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.302395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.302395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:26.302395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.302918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.307815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:26.318823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 389/792] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:26.330475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:26.437734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbacc8-ce84-495f-8777-bc9d09395144 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.512870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.514060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.514532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.515516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.524873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12b377-5ae2-45ec-a1dd-40f10a7b7051 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.534126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.535900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:26.569610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:26.570568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:26.571500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:26.578662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 404/793] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:26.584728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:26.606254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.607337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.607772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.608234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.613602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:26.621147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.622653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:26.647936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:26.649189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:26.650200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 390/794] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:26.659691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:26.778231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef495a-9236-41bf-8e42-d491628dd4fe None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.816891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.817595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.817884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.818162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.819008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:26.819321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.820875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.840943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 391/795] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:26.850786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:26.854939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:26.874695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59810-7462-42f7-bd06-6c856d00fdc6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:26.941991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:26.943095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.943621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.944141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.945363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:26.945896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:26.947730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119c099-23e3-4da1-abcb-456ef700b99f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:26.953430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:26.979783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 405/796] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:26.986358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e88a-ca8d-4851-b8c7-37581b3fa7b3 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:26.986358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e88a-ca8d-4851-b8c7-37581b3fa7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:26.986608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e88a-ca8d-4851-b8c7-37581b3fa7b3 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:26.988221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 406/797] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:26.990055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e88a-ca8d-4851-b8c7-37581b3fa7b3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.028716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1cc1c-27f3-4ad4-a6f9-18a8124c56d9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.078884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.080713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.081266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.081807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.097861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.100211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-55863617-5b99-4d82-b760-0a4b5d7f6b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:27.126422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:27.127398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:27.128287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:27.128287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:27.128287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:27.128287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:27.134829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e88a-ca8d-4851-b8c7-37581b3fa7b3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.135611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 392/798] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:27.138456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.138750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.139028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.169434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:27.172171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:27.180007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.181050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.181589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.182097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.199223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.200811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:27.224409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:27.225494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:27.226423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:27.226423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:27.226423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:27.226423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:27.230643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 407/799] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:27.232093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.235883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:27.297741 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 393/800] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:27.299055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.352062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:27.365903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fe5f3-2999-467b-9610-40a66759b7da None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.423651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.424334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.424625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.424912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.425694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:27.426011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.427395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.440001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe50ce-cd65-47ee-9b54-cec2719877a9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.446140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 408/801] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:27.446140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.489050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.489820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.490115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.490399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.491143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:27.491479 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.492993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.514435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 394/802] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:27.514435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.537797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:27.579903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9af3-59a5-4e67-8086-592b15c4edea None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.614018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.614736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.615027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.615311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.625240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:27.626167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:27.631908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1da2-2973-410c-aeb4-ca9941a2d4e7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:27.634003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:27.643460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 409/803] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:27.644300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.670065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.671361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.671668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.671947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.681003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.682561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1cad33d0-dbcb-435e-8333-0799ce5efc41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:27.698876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:27.699795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:27.700707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 395/804] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:27.701796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a754529-def6-4f4d-8ecf-20ad042b82de None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.702122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a754529-def6-4f4d-8ecf-20ad042b82de None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.703082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a754529-def6-4f4d-8ecf-20ad042b82de None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.704608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 396/805] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:27.705767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd99c-4c61-4234-b108-b3204f018a41 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.706059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd99c-4c61-4234-b108-b3204f018a41 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.706342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd99c-4c61-4234-b108-b3204f018a41 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.707578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 397/806] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:27.708382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdd99c-4c61-4234-b108-b3204f018a41 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.763740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc573-8a36-49f4-a9a2-a9bc2b1e78de None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.786424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:27.798427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.799212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.799497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.804821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.806454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.807898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.813068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdd99c-4c61-4234-b108-b3204f018a41 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:27.822815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:27.823929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:27.824861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 410/807] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:27.825408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.853260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.853956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.854245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.854525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.855267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:27.855578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.856971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25e4de-5e03-4bd0-bd2f-4b9c9eff3d19 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.865110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 398/808] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:27.866396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99736aeb-e108-4407-9de0-7b47f3576e89 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.866693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99736aeb-e108-4407-9de0-7b47f3576e89 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.867012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99736aeb-e108-4407-9de0-7b47f3576e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.884076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-99736aeb-e108-4407-9de0-7b47f3576e89 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:27.885319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-99736aeb-e108-4407-9de0-7b47f3576e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:27.896989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:27.928866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e4452-bed7-4d29-b1eb-746b9d4e7f2c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:27.956359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 399/809] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:27.957990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.958484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.958933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.964572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:27.965329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:27.965697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:27.966035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:27.966887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:27.967535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:27.969978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:27.982878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 411/810] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:27.983716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:27.991054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:27.992304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:28.036568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.064116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 400/811] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:28.064993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.096590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d099-49ac-4aca-8ab4-325fcf6e6dc2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.131258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.131846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.132136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.132424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.133212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:28.133559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.134984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.147726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 412/812] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:28.148526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.148767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.172650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d33ba9-c7e1-4157-be21-161017eb0d67 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.208010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.208792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.209081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.209393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.219246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.220697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:28.238175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:28.239285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:28.240228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:28.240228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:28.240228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:28.240228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:28.240228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 401/813] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:28.240228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.252394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522a82f-c64d-4fca-b4f6-a8a4d72ba5e0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.254166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.288236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.289079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.289588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.290064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.291036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.292403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:28.307086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:28.308277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:28.309326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 413/814] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:28.310289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.348417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352382-882e-4400-a1a9-8a9b59b6e423 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.379109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.387767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.388691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.388984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.389266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/4f3bfddef4664aad9d210fbeb52acda9/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.391555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=4f3bfddef4664aad9d210fbeb52acda9, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.393002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.412757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a28d5-d016-4fd1-acc4-1e3ecd61e0b5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.446678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.447480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.447767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.448042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.448691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.450077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:28.462364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:28.463444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:28.464455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 414/815] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:28.465417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.484507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 402/816] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:28 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/4f3bfddef4664aad9d210fbeb52acda9/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:28.485411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.496373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.574913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2823962-132a-424e-8c5f-30dc5d99e356 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.614987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c63c2-80e3-4cf8-be0b-c1b1b4c820a4 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.617124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.619001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.619310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.619575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/2d8f0f57e4e8406dbab4cbcbe9836267/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.636718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=2d8f0f57e4e8406dbab4cbcbe9836267, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.639361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.658693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.659373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.661376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.661376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.661376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:28.661376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.662572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.675445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 403/817] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:28.676644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.728715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.737320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 415/818] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:28 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/2d8f0f57e4e8406dbab4cbcbe9836267/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:28.737320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.795698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315840e7-f73f-443e-a54e-44e0cdd9b705 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.828914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:28.852142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.852694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e1a8-85cd-4c71-a96f-838fceb3be60 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:28.852866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.853121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.853455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.854328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] RBAC: Adding query filter params (name=network) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:28.854567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.857578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.865075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 404/819] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:28.872448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:28.907485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:28.907485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:28.907485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:28.907485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:28.907891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:28.907891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:28.908539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:28.919022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 416/820] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:28.920029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:29.005689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8659b-443e-401c-8d67-683fe6cb493c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.024671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:29.050618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3589-1cb4-4121-9f8b-8c138601680b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.057246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.058132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.058962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.059252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.071210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.072688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.088564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.089233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.089566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.089852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.090572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] RBAC: Adding query filter params (type=network) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:29.090883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:29.092319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:29.094271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:29.096284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:29.097530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.097675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 405/821] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:29.097675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:29.103805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 417/822] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:29.109086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:29.122262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:29.211395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a5d47-a88a-4632-a24b-c9eab363eec1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.237561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27d6c-192e-4471-84b8-3dc9b47e9769 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.256702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.257489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.257758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.258039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.258765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:29.259080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.260481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.272468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 406/823] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Jun 21 16:29:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:29.273159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:29.291474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.292720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.293189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.293835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.295149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:29.295663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.297891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.313148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:29.322836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 418/824] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:29:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:29.323902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:29.404211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:29.410493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8533b-64cf-46da-a78d-694fcbca258c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.448811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.449516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.449831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.450119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.450869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.451903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb834b7-1295-4acf-910e-716ee22a7a6d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.452428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.493052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.493699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.493990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.494321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.495124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.496500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.576744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 407/825] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:29.578176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:29.647940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 419/826] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:29.722362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:29.748473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc80fd4-6d08-4217-86f9-5c732a3b8443 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:29.807136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:29.807813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:29.808103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:29.808416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:29.887382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:29.888938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:29.991331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:30.011468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 408/827] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:29:30.017175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:30.130306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161beb-4da8-48a8-912c-19468246ee87 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:30.154405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:30.166416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:30.167495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.170010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.170010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.179494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:30.181246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:30.199481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:30.200395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:30.201270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:30.201270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:30.201270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:30.201270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:30.204488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 420/828] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:30.209848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:30.314934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291373cd-474b-449d-ae82-a684fc4ee2e2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:30.350537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:30.351269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.351557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.351877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.352607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:30.352914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:30.354434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:30.367668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 409/829] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:30.372916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:30.477309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7bd0b-96fe-4367-a31c-d8711af52498 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:30.512616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:30.513453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.513746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.514029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.521256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:30.522692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-62a4b633-9777-4d38-a82b-b02a184b411b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:30.537451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:30.538411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:30.539379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 421/830] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:30.544488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:30.593957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:30.651903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb785c04-d99f-4fbc-9d93-f598ec52eeeb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:30.688949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:30.689695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.689978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.690256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.691451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:30.691761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:30.693303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:30.695044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136bc3-f8b9-448f-b690-e3470bcf4183 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.695337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136bc3-f8b9-448f-b690-e3470bcf4183 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.695619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136bc3-f8b9-448f-b690-e3470bcf4183 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.697156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 422/831] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:30.702693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.703227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.703725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.706284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 410/832] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:30.717328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:30.726677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:30.728381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:30.769346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:30.824296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cfd86-e2b2-40ea-8a0c-93fde4ef84ca None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:30.825171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 423/833] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:30.828018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:30.850581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:30.863100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:30.863772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.864062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.864374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.865238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=9687c85240694148aa572d8807ada25b) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:30.865591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:30.867162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78dd09-1f57-4bca-bf84-eb04b625c4b8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:30.873883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 411/834] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:30 2022] GET /identity/v3/role_assignments?user.id=9687c85240694148aa572d8807ada25b&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:30.964029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a9444-823f-4505-96aa-66c0fb622590 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:30.987915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897ae22-bd3e-4a41-aa90-532c89680446 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.988445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897ae22-bd3e-4a41-aa90-532c89680446 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.988525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897ae22-bd3e-4a41-aa90-532c89680446 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:30.990306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 412/835] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:30.998111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:30.998400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:30.998690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.004869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.005985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.006443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.006732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.019331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:31.021519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:31.022750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:31.027203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:31.028162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:31.029001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 424/836] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:31.034752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.072021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.116871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 413/837] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:31.142115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.174386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0736f-f109-4232-bd49-e4b94e9e0659 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.220607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.221504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.222150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.222444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.223535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:31.223858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.225497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.241381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 425/838] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:31.242894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.279848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.288944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f42072-75c5-4b0c-aea8-2edd2c9684ad None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.339422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.340381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.340775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.341349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.355415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:31.359188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:31.366344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:31.367471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:31.368422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 414/839] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:31.373715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.378773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bb60-8595-4ef6-90a9-aaa9c0998182 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.415290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.416098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.416389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.416671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.430463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.452158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:31.457323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:31.458227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:31.459144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:31.459144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:31.459144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:31.459144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:31.459393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 426/840] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:31.465115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.507423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7633e84-b776-400b-813e-da213d5925fe None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.550553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.551595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.552104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.552608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.553653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:31.554185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.555874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.565612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 415/841] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:31.570746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.594594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dd1a8-aee6-4b1b-bf13-1dfdb08e716f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.641570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.642736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.643556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.644315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.645451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:31.645985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.648178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.665026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 427/842] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:31.670214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.693558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ada4d-2e1b-4b91-93c5-8f9b7e74fca3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.735915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.737009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.737319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.737620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.751406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.753552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:31.776769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:31.777810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:31.778716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:31.778716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:31.778716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:31.778716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:31.781244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.783048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 416/843] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:31.783900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.793107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.805899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c7116-0594-4f47-a15e-aabaa2ad7efd None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.846235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.848858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.849145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.849455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.858304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.860117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.868102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:31.876933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:31.877960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 16:29:31.879017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:31.882007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 428/844] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:31.895112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:31.902739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dd72-8b5a-4a37-b33e-4fd7c900cf8e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:31.943473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:31.944247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:31.944547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:31.944835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:31.945703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:31.946026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:31.947533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:31.962120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 417/845] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:31.967305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:31.969608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.013897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de023e2b-addc-4e46-86c6-fcdec839a45f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.049791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.050832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.051331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.051796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.052882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:32.053407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.055062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa80ec-0258-48c6-98a6-77bffd8900ff None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.077648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 429/846] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:32.079281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1bd8-40c4-4186-ae63-c103ee721e5e None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.079773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1bd8-40c4-4186-ae63-c103ee721e5e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.079888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89652c54-4880-405c-9df2-ba1089836ac5 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.080695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1bd8-40c4-4186-ae63-c103ee721e5e None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.082250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 430/847] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:32.083153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1bd8-40c4-4186-ae63-c103ee721e5e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.119284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.124734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.125593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.125883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.126166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.133969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.135457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-2f4af56b-0184-4ce9-a224-520bec418b9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:32.153774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:32.155731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 418/848] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:29:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:32.156812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.158045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.158045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.174472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:32.175686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:32.200409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1bd8-40c4-4186-ae63-c103ee721e5e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.221993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.242528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.243195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.243492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.243756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.328053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.329577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.366425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 419/849] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:32.367353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.438551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 431/850] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:29:32.440042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.458940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.485558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe335c7-47a9-4368-910d-bfb5f5ff13f9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.513489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.528694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.530622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.530622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.530622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.531865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:32.532181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.534102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.543185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434ff64-0bdb-43c9-a715-2f296bd05e65 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.559435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 420/851] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:32.559435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.588460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.589257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.589572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.589850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.590512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.592134 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:32.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:32.605969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:32.607438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 432/852] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:32.608989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.670180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416b330-2991-42c0-a436-16e6e11954f8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.696326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.708300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.709102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.709419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.709702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.717485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427240f2-dc92-4ba2-bc54-08c5644bc8e0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.720874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.722371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:32.740085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:32.741029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:32.741966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:32.741966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:32.741966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:32.741966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:32.741966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 421/853] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:32.742246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.761960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.762930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.763534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.764057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.777868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.836437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.837967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.854338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5c432-c13c-42aa-9f99-3d175877f04f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:32.888477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:32.889142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:32.890048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:32.890333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:32.891229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:32.891562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:32.892941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:32.897970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 422/854] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:32.898956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:32.930357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:32.950537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 433/855] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:29:32.951646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.005746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.011863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441e68-85c6-4c7e-9844-e448c60fab52 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.049946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.051010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.051454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.051906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.052911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.053488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.054938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.059359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e310a9-2dda-4ab9-810a-c0b0890acce7 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.072894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 423/856] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.072894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.104607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.105324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.105618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.105901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.106610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.106922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.108355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.113082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 434/857] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.113903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.178709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.186878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b96a6-f5c8-48f0-b26b-0f3965bea34d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.226566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.227287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.227570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.227852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.240526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.242066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.243407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b21c19-b61e-448a-9e90-1fb5a866eb6b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a184438b-aa10-41cb-8e06-3314654da1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:33.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:33.262394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:33.263319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:33.263319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:33.263319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:33.263319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:33.263319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 424/858] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:33.265731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77048902-7198-4fec-b76c-1e0e29d1982b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.265731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77048902-7198-4fec-b76c-1e0e29d1982b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.265731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77048902-7198-4fec-b76c-1e0e29d1982b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.271060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 425/859] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:33.272038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77048902-7198-4fec-b76c-1e0e29d1982b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.284985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.295267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.303338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.303338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.303338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.306743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.308206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1a6a55e5-e9bc-43f3-bc4a-9bcdd4ab77f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:33.323906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:33.324867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:33.326147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 435/860] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:33.326653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.327523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.327833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.345903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:33.347098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:33.399397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77048902-7198-4fec-b76c-1e0e29d1982b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.417344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 436/861] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:33.417344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.447181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.447949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.448318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.448614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.449384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.449700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.451091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.455859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.463832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 426/862] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.469226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.526743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ef64-db24-4d6e-9c4e-94a5d33912ba None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.538609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.563522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.564191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.564482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.564770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.565597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.565948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.567370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.573605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10282-a26a-4a20-86d9-0639bc8a1351 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.581327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 437/863] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.581492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.614574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.615381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.615666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.615945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.616596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.618002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:33.631042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:33.632044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:33.632904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 427/864] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:33.634268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.697746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.704482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047010f2-f087-4e21-8ee0-73938af3f8b6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.739413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.740602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609f15-b995-4624-97bd-5c47f8db8ebb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.740867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.741153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.741465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.750442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.752564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:33.767453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:33.768574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:33.769492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 438/865] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:33.769983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.777043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.783094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.783752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.784035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.784307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.785129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=4f3bfddef4664aad9d210fbeb52acda9) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.785483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.786909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.792869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 428/866] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/role_assignments?user.id=4f3bfddef4664aad9d210fbeb52acda9&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.794107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.889834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4e8bc-5537-48ac-9303-1dd00f19326e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.915215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138945-3ba1-43c7-a0db-3ed5c3ea7616 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:33.929773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.930458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.930747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.931029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.931755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.932066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.933609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.939388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 439/867] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.944895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:33.960162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:33.961342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:33.961840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:33.962314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:33.963374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:33.963792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:33.965117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:33.972938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:33.979261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 429/868] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:33.986384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:34.053238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:34.074163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89a9e2-747b-4b87-8f56-fe7d3cbf8ae7 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:34.110373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93141a-7b34-4657-a9dc-a02883519c8b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:34.118410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:34.119160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:34.119518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:34.120268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:34.121437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:34.121830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:34.123876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b6e12-9b05-4bde-be59-7c2d1b3569d8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:34.130201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 440/869] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:34.147870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:34.148549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:34.148836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:34.149118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:34.150005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=2d8f0f57e4e8406dbab4cbcbe9836267) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:34.150324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:34.151875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248296-ed77-41a1-b77c-5997ebb207fd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:34.160130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 430/870] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:33 2022] GET /identity/v3/role_assignments?user.id=2d8f0f57e4e8406dbab4cbcbe9836267&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:35.221237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f489e-4c8c-4f61-8b9a-a94e6496b839 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:35.221849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f489e-4c8c-4f61-8b9a-a94e6496b839 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:35.221849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f489e-4c8c-4f61-8b9a-a94e6496b839 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:35.223488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 441/871] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:35.228870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c4a4-ac3a-485e-aadc-f7fca4c436a8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:35.229272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c4a4-ac3a-485e-aadc-f7fca4c436a8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:35.229484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c4a4-ac3a-485e-aadc-f7fca4c436a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:35.246499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bb99c4a4-ac3a-485e-aadc-f7fca4c436a8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:35.247695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb99c4a4-ac3a-485e-aadc-f7fca4c436a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:35.321348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 431/872] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:35.345694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f489e-4c8c-4f61-8b9a-a94e6496b839 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:35.456057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:35.475914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f489e-4c8c-4f61-8b9a-a94e6496b839 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:35.511416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc275257-2c1c-411e-a5a6-5d76ba972cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:35.512077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc275257-2c1c-411e-a5a6-5d76ba972cd6 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:35.512373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc275257-2c1c-411e-a5a6-5d76ba972cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:35.512651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc275257-2c1c-411e-a5a6-5d76ba972cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:35.513418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc275257-2c1c-411e-a5a6-5d76ba972cd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:35.515828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc275257-2c1c-411e-a5a6-5d76ba972cd6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:35.626641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 442/873] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:35 2022] POST /identity/v3/services => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:36.020373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdea8d-2304-455b-a16d-53b3ee426f21 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.021067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdea8d-2304-455b-a16d-53b3ee426f21 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.021685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdea8d-2304-455b-a16d-53b3ee426f21 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.023544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 432/874] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:36.029062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6300d5-12c4-48b0-a2d0-8cf08e5416e0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.029630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6300d5-12c4-48b0-a2d0-8cf08e5416e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.031189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6300d5-12c4-48b0-a2d0-8cf08e5416e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.048719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-df6300d5-12c4-48b0-a2d0-8cf08e5416e0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:36.050271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-df6300d5-12c4-48b0-a2d0-8cf08e5416e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:36.127445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 443/875] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:36.150206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdea8d-2304-455b-a16d-53b3ee426f21 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:36.203975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:36.254990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdea8d-2304-455b-a16d-53b3ee426f21 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:36.257924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da4e6-a422-4518-93e4-61fee5a38e53 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.258305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da4e6-a422-4518-93e4-61fee5a38e53 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.258483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da4e6-a422-4518-93e4-61fee5a38e53 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.274467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 444/876] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:36 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:36.275811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.276105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.276393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.294642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:36.296510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:36.302662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:36.304011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.304516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.305506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.306194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:36.314967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:36.328978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:36.330129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:36.330957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:36.334794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 433/877] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:36.340904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:36.377745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:36.384929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 445/878] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:36.412550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:36.458599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5200f-f62d-46ac-b92c-eadcc8a84028 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:36.476906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:36.505953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:36.506984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.507462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.507934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.509153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:36.509914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:36.512551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80118b8-27e8-4a62-87fa-1beff27c2701 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:36.521258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 434/879] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:36.522905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772839-0541-4730-9aad-df57d98df510 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.523274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772839-0541-4730-9aad-df57d98df510 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.523636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772839-0541-4730-9aad-df57d98df510 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.525164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 435/880] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:36.526383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa772839-0541-4730-9aad-df57d98df510 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:36.541003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cbb43-f09d-4665-a364-f9ead40379a0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:36.574733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:36.575393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.575681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.575963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.577297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:36.578763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:36.634856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa772839-0541-4730-9aad-df57d98df510 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:36.669141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:36.669831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.670120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.670623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.671381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:36.671688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:36.673066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278fd13-e09a-46e6-8c3b-df97d42d5f01 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:36.677612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 436/881] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:36.680212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.680212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.680212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.698523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:36.700017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:36.741363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 446/882] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:36 2022] POST /identity/v3/services => generated 269 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:29:36.751526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:36.799225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 437/883] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:36.824802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:36.895108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:36.940612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48798a-8115-4ab9-a8c7-1242c4090ea2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:36.976929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:36.977781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:36.978123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:36.978409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:36.990728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:36.999233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:37.001063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:37.002255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 447/884] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Jun 21 16:29:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:37.006588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:37.108420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c5338-c8c1-48c1-ad8d-a67b1b20da9b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:37.148215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:37.148892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.149181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.149492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.150240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:37.150549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:37.151992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:37.161064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 438/885] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:37.166222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:37.281312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d3bd-a21a-4e19-a0aa-f941b2257f40 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:37.301265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:37.319814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:37.320976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.321515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.322004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.335024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:37.336797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:37.356767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:37.357791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:37.358858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:37.358858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:37.358858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:37.358858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:37.361318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 448/886] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:37.371028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:37.399485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:37.479365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a025e-cc0a-445e-b6ea-e00064170ea2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:37.516495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:37.517172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.517490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.517774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.518503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:37.518813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:37.520201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:37.533818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 439/887] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:37.539356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:37.650685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66ac77-5348-4178-8b01-261c8bb7d032 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:37.685348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:37.687049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.687546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.688028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.699270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:37.699270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-4c32d155-7edb-4079-9e9e-92810285477e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:37.713380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:37.714334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:37.715275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 449/888] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:37.722657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:37.816512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942dc6-75f6-48d1-9b41-901b93184034 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.816841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942dc6-75f6-48d1-9b41-901b93184034 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.817093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942dc6-75f6-48d1-9b41-901b93184034 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.818800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 450/889] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:37.819378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:37.823907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.824295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.824610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.833156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fb0e3-3e5c-4b59-a5da-f7f5bb9e0155 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:37.844365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:37.845922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:37.878028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:37.879533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:37.880092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:37.880558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:37.882053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:37.882681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:37.884374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:37.889919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:37.909310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 440/890] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:37.914871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:37.937528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 451/891] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:37.958814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.046852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838edc6-97dd-4478-a1b6-025f2536b464 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.071695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59717e1-df08-4b57-a3ca-2dd497964498 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.091224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.094012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.095105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.095585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.109387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.110191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.110555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.111137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.111669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.113218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.119450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:38.132303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:38.137366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:38.138312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 452/892] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:38.141193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.173857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:38.188392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.190622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.275019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d069f2-46f3-4795-97d3-174d8b59d719 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.307389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 441/893] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 16:29:38.314004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.321765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.323597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.324062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.324496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.325855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:38.326421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.329018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.336574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 453/894] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:38.346220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.381923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:38.448224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cd1f4-1e58-4b31-95bd-3c88a03a4ad5 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.472541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:38.488977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daa8a0-475d-4edd-b12a-006a7c99cf9a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.496770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.497735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.498698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.499260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.514123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.516291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.532705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.533639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.534100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.534531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.535395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:38.535855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.537443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:38.539630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:38.540635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:38.541623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:38.541623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:38.541623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:38.541623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:38.541852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 442/895] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:38.551193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.551426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 454/896] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:38.552438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.674474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:38.678176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352ca0-dc5b-4ba9-943f-baa4b19b3364 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.682289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68cf3-7863-432d-b791-be37445f60f1 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.717691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.719603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.720109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.720856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.722359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:38.723031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.724626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.726696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.727361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.727653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.727938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.729200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] RBAC: Adding query filter params (interface=public, service_id=114375369d234142bd427cc05e4907af, region_id=RegionOne) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:38.729572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.730935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.741430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 455/897] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/endpoints?service_id=114375369d234142bd427cc05e4907af&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:38.743058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.745200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 443/898] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:38.752230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.769617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:38.861615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89de47-d5bf-496b-9696-376db027b4db None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.865240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ee89-c704-4c7e-bada-d0f05ec61e08 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:38.899564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c3981-49f9-4e74-ad1e-ec92dbf6942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.900237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3981-49f9-4e74-ad1e-ec92dbf6942d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.900528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3981-49f9-4e74-ad1e-ec92dbf6942d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.900813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3981-49f9-4e74-ad1e-ec92dbf6942d None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.901535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c3981-49f9-4e74-ad1e-ec92dbf6942d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.902901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c3981-49f9-4e74-ad1e-ec92dbf6942d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.903852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:38.905545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.906045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.906549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.916678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 456/899] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:29:38.918322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:38.919888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:38.937774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:38.938926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:38.940003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:38.940758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779164f-50fc-420a-b8c1-5799d9fea15e None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.940900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779164f-50fc-420a-b8c1-5799d9fea15e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.945337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 444/900] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:38.945467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779164f-50fc-420a-b8c1-5799d9fea15e None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.945467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 457/901] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:38.947312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:38.947755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04cb16-3f01-4d71-b265-03c838a59f00 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:38.948165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04cb16-3f01-4d71-b265-03c838a59f00 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:38.948553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04cb16-3f01-4d71-b265-03c838a59f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:38.968609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6f04cb16-3f01-4d71-b265-03c838a59f00 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:38.969922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6f04cb16-3f01-4d71-b265-03c838a59f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:38.974469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:39.053109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 458/902] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:39.059352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a9c0-1e73-400d-a156-365682b84987 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.059878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a9c0-1e73-400d-a156-365682b84987 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.061237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a9c0-1e73-400d-a156-365682b84987 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.067902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413829b-2774-48cb-9389-bf400ac2d68d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:39.068789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 459/903] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:39.071431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926acd-7430-4594-b002-9596792622f2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.071936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926acd-7430-4594-b002-9596792622f2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.072360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926acd-7430-4594-b002-9596792622f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.090803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c8926acd-7430-4594-b002-9596792622f2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:39.092980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c8926acd-7430-4594-b002-9596792622f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:39.096888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:39.111889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:39.113319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.113319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.113319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.114016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:39.114335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:39.115778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:39.129060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 445/904] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:39.129925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:39.172961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 460/905] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:39.173474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8926acd-7430-4594-b002-9596792622f2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:39.230218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:39.250210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60934f3d-5353-4ab4-860a-4615c51befc8 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:39.289751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:39.290448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.290737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.291016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.291735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:39.293310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:39.298241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8926acd-7430-4594-b002-9596792622f2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:39.332737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:39.333504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.333695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.333977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.334811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] RBAC: Adding query filter params (role.id=0df32789fda94794a0731f80a867968e, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=2d8f0f57e4e8406dbab4cbcbe9836267) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:39.335129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:39.336594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:39.342418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 461/906] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:39 2022] GET /identity/v3/role_assignments?user.id=2d8f0f57e4e8406dbab4cbcbe9836267&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=0df32789fda94794a0731f80a867968e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:39.343284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:39.348042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:39.400520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 446/907] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:39 2022] POST /identity/v3/services => generated 241 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:39.468188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c332d7-df21-44ad-8c7c-225becd7ef79 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:39.517126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:39.518012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.518310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.518577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.519267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:39.520692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:39.534478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:39.535682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:39.536988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 462/908] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Jun 21 16:29:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:39.542070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:39.659771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5d7b-ed88-4ab9-ac7b-cd87244aa980 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:39.695671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:39.696604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.697039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.697505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.698385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:39.698842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:39.700378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:39.706898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 447/909] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:39.713325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:39.785608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:39.824912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a77af7-38d4-4f3b-8fe9-58f2b178bfea None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:39.863463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:39.864497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:39.864983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:39.865501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:39.866447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:39.866968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:39.868547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:39.874405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 463/910] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:39.880360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:39.884074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:39.988353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb505ef-35a1-43ed-8110-f834e5a3e65f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:40.023345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:40.024262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:40.024723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:40.025166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:40.026166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] RBAC: Adding query filter params (interface=public, service_id=1ac7170e23e240cda349db13578df1e9, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:40.026633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:40.028167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ee99-6150-49a2-9bef-2691833ea9f3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:40.034942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 448/911] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:39 2022] GET /identity/v3/endpoints?service_id=1ac7170e23e240cda349db13578df1e9&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:40.040802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:40.156669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1bad-84da-4238-b6a8-fd5eb859d350 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:40.184348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:40.193621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964afca-351e-44db-a55a-4be0755c4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:40.194290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964afca-351e-44db-a55a-4be0755c4229 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:40.194579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964afca-351e-44db-a55a-4be0755c4229 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:40.194861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964afca-351e-44db-a55a-4be0755c4229 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:40.195557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964afca-351e-44db-a55a-4be0755c4229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:40.196928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964afca-351e-44db-a55a-4be0755c4229 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:40.203741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 464/912] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:40 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:29:41.059005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9a53-7a68-49cd-8ae1-de856d245dae None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.059530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9a53-7a68-49cd-8ae1-de856d245dae None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.059608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9a53-7a68-49cd-8ae1-de856d245dae None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.062086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 449/913] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:41.067440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.067885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.068029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.085525 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:41.086719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:41.161814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 465/914] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:41.180314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9a53-7a68-49cd-8ae1-de856d245dae None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:41.262799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:41.290397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9a53-7a68-49cd-8ae1-de856d245dae None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:41.328702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:41.329468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.329922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.330200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.330855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:41.332227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:41.346436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:41.347438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:41.348275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 450/915] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:41.354645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:41.458749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa536c8-ca8a-46b2-8fb1-dbada6809754 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:41.485607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:41.497758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:41.498722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.499105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.499395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.500111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:41.500425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:41.501854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095fab6-389b-4e58-812a-43c08c0925c6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:41.511436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 466/916] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:41.514211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:41.554873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f0f9-bebe-48e4-839b-551963dae263 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.555517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f0f9-bebe-48e4-839b-551963dae263 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.556005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f0f9-bebe-48e4-839b-551963dae263 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.558000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 467/917] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:41.564537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecf288-d95a-472b-8778-404c3bc2f904 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.565187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecf288-d95a-472b-8778-404c3bc2f904 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.565701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecf288-d95a-472b-8778-404c3bc2f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.583196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-a1ecf288-d95a-472b-8778-404c3bc2f904 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:41.584298 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a1ecf288-d95a-472b-8778-404c3bc2f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:41.625957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc078e-e90d-4043-bffe-f01295b693ae None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:41.656386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 468/918] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:41.658031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410866ba-c1b4-4391-99a2-c9d4adf034ee None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.658513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410866ba-c1b4-4391-99a2-c9d4adf034ee None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.658997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410866ba-c1b4-4391-99a2-c9d4adf034ee None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.660466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 469/919] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:41.665820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.665950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:41.666877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.667371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.672057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:41.672737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.673073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.673394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.674329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:41.674652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:41.677017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:41.684844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 451/920] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Jun 21 16:29:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:41.685859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:41.687851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:41.689243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:41.771657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 470/921] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:41.772717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:41.798994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba265c-d22a-41bf-bcba-dc30e72641c3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:41.832416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:41.837455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:41.838207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.838857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.838857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.839417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:41.840806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:41.854629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:41.855644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:41.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 452/922] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:41.858042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:41.893004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16408684-86b3-4f6d-9b64-50b92fc1f728 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:41.922593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:41.929619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:41.930291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:41.930581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:41.930867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:41.931613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:41.932984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:41.965036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c39910-83b8-462c-8e38-f207db3587d1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.001221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.002054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.002335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.002608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.012374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:42.021602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:42.022925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 453/923] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Jun 21 16:29:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:42.024271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.042400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 471/924] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:42.043318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.160459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56bf28-8db6-44db-86fc-ff6a5ca6f604 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.187892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:42.202187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:42.206907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9beb71-972f-46a8-a237-323fb6df45c7 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.208620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.210558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.211103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.211610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.212569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:42.213091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.215464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.223441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 454/925] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:42.228813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.265437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.266157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.266452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.266768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.267512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:42.267828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.269240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.280903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 472/926] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:42.288013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.375428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337dd54-71ea-4eae-873f-b29abb427365 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.406279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d312b-8e72-4037-af83-873fcf445ce9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.411483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.412086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.412372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.412876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.413626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:42.413943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.415317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b8688-3f4b-446b-9e52-d6c8c89dc043 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.422180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 455/927] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:42.428682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989f61-f899-4de7-8343-b213a9b2c5a0 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.428971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989f61-f899-4de7-8343-b213a9b2c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.429246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989f61-f899-4de7-8343-b213a9b2c5a0 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.430582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 456/928] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:42.431260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d989f61-f899-4de7-8343-b213a9b2c5a0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.446771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.447852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.448324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.448681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.460100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.461624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-f106860b-34b7-47c6-850b-3667c2a2110e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:42.479996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:42.480962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:42.482740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:42.482740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:42.482740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:42.482740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:42.482740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 473/929] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:42.483035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.483337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.483706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.494356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:42.501167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:42.502514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:42.511073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:42.548332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d989f61-f899-4de7-8343-b213a9b2c5a0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.572888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 474/930] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:42.574132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.603561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.604875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.605171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.605476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.606547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] RBAC: Adding query filter params (interface=public, service_id=aaa962f2cc7a4b8f8fabf2a75d994fce, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:42.606868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.609546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.615254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 457/931] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/endpoints?service_id=aaa962f2cc7a4b8f8fabf2a75d994fce&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:42.617395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.696067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4feef-0b55-47ae-ba81-9e747794757d None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.727558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff03c7-8d9b-43cf-8ce5-fdacaf9cfde9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.730897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.731627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.731981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.732866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.734140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:42.734515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.735958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.742073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:42.748667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 475/932] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:42.749872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.752572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:42.770417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.771319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.771677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.772027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.772756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.774170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:42.788469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:42.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 16:29:42.790818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:42.795978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 458/933] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:42.796866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.864804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dad65-ccb2-42c9-aa0f-b2ada2892d75 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.901119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.901804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.902088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.902368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.902646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c95d8-91d1-4bfc-9188-6c79800da39e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:42.903054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.905622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.921314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 476/934] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:29:42.921314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:42.954026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:42.954926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:42.955277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:42.955617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:42.964490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:42.966195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:42.983818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:42.984852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:42.985823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 459/935] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:42.991298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.007598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:43.044010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:43.051986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a728-9b3f-4c9a-8416-eb06ad17529c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.093193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.093425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.093956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.094960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.095696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:43.096339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.097823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.103458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 477/936] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:43.111855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.139529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b599-4744-421e-8d01-28d6886c3c34 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.179715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.181381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.181900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.182383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.183623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:43.184177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.186207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.206295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 460/937] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Jun 21 16:29:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:43.214653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.240921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1053e-67e6-4052-ad59-34184ca61d3e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.283766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:43.290561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.291464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.291915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.292348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.293214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:43.293712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.295993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.301856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 478/938] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:43.313314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.329678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:43.332697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d475-dd24-411c-9a02-b5fca80e63f9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.369905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.370708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.370990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.371263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.382895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.384461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:43.402920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:43.403856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:43.404783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:43.404783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:43.404783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:43.404783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:43.409445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 461/939] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:43.410435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.449414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f901c-bbb1-4f67-9089-3b4c5cbad621 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.499757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.501367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.502283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.502855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.504148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.506034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.526420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e087-d0ab-44cf-af6a-16b92fc6a4ac None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.563386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.564413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.564889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.565394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.566316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:43.566900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.568503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.580890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 462/940] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:43.586181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.597705 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:43.661727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 479/941] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:43.709830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295da8a7-5c95-4897-95e7-de430375d984 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.758889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.760051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.760539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.761047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.769968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.771840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:43.788312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:43.789316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:43.790211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:43.793171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 463/942] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:43.801719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:43.861878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:43.916864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357ee5-8d8f-46d6-958e-7fdba908e15d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:43.953518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:43.954185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:43.954476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:43.954757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:43.955558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:43.955873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:43.957335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4152914-4749-471f-b0f7-482eae83ff01 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:43.971223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 480/943] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:43.977093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:44.045762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:44.087962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52689-eaaf-4ba1-908d-e255124fa048 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:44.128515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8084a89-cf11-4aeb-949c-689f88879ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:44.129848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084a89-cf11-4aeb-949c-689f88879ff6 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:44.130338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084a89-cf11-4aeb-949c-689f88879ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:44.130836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8084a89-cf11-4aeb-949c-689f88879ff6 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/2d8f0f57e4e8406dbab4cbcbe9836267/roles/0df32789fda94794a0731f80a867968e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:44.133319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8084a89-cf11-4aeb-949c-689f88879ff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=2d8f0f57e4e8406dbab4cbcbe9836267, role_id=0df32789fda94794a0731f80a867968e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:44.135010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8084a89-cf11-4aeb-949c-689f88879ff6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:44.237108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 464/944] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:29:43 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/2d8f0f57e4e8406dbab4cbcbe9836267/roles/0df32789fda94794a0731f80a867968e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:29:44.243887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1b11-d7b2-484c-ac68-fb31ec260b75 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:44.244403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1b11-d7b2-484c-ac68-fb31ec260b75 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:44.244510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb1b11-d7b2-484c-ac68-fb31ec260b75 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:44.246256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 481/945] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:44.253223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628752-e20f-45a6-9039-11932262c206 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:44.253890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628752-e20f-45a6-9039-11932262c206 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:44.254396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628752-e20f-45a6-9039-11932262c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:44.274760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0f628752-e20f-45a6-9039-11932262c206 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:44.276359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0f628752-e20f-45a6-9039-11932262c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:44.360872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 465/946] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:44.385169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1b11-d7b2-484c-ac68-fb31ec260b75 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:44.500237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb1b11-d7b2-484c-ac68-fb31ec260b75 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:44.511993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:44.542109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:44.543141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:44.543623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:44.544094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:44.545057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:44.546758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:44.548487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING keystone.server.flask.common [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 16:29:44.606367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.sql.core [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 16:29:44.606367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 16:29:44.606367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [parameters: {'id': '6e2e3aabeeee4a98ae40a145fc7cc994', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 16:29:44.606367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6e2e3aabeeee4a98ae40a145fc7cc994.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6e2e3aabeeee4a98ae40a145fc7cc994. Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application conn.query(q) Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 16:29:44.625699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application result.read() Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 16:29:44.626577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application next(self.gen) Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application yield resource Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application next(self.gen) Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise self.value Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application session.commit() Jun 21 16:29:44.628079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self.session.flush() Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application compat.raise_( Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 16:29:44.629019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 16:29:44.630877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application conn.query(q) Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application result.read() Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 16:29:44.632815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [parameters: {'id': '6e2e3aabeeee4a98ae40a145fc7cc994', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:44.635018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:44.636886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6e2e3aabeeee4a98ae40a145fc7cc994. Jun 21 16:29:44.640045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:44.643072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 482/947] 10.222.0.70 () {60 vars in 1140 bytes} [Tue Jun 21 16:29:44 2022] POST /identity/v3/projects => generated 262 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:44.648794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628752-e20f-45a6-9039-11932262c206 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:44.707348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:44.758362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628752-e20f-45a6-9039-11932262c206 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:44.795767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:44.796586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:44.796870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:44.797138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:44.804417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:44.805924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-61ebfd9f-21ea-4b08-aace-fa33ce4f2154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:44.820395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:44.821430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:44.822405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:44.825404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 466/948] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:44.828309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:44.943581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b97c-b600-41c8-9c3c-7203d221a9dd None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:44.978582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:44.979599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:44.980087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:44.980578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:44.981562 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:44.982720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:44.984628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4865f2-11b1-46e5-965b-57a40eb73997 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:45.006166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 483/949] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:45.096714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a4fc8-04df-425d-984f-206bdd3d7e32 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.097073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a4fc8-04df-425d-984f-206bdd3d7e32 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.097302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a4fc8-04df-425d-984f-206bdd3d7e32 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.099027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 467/950] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:45.104642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.104937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.105226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.125021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:45.126669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:45.149756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:45.200476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 484/951] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:45.225436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a4fc8-04df-425d-984f-206bdd3d7e32 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:45.348159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a4fc8-04df-425d-984f-206bdd3d7e32 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:45.362174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:45.384298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:45.385113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.385431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.385716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.386373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:45.387818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:45.401144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:45.402320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:45.403852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 468/952] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:45.410372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:45.515718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551722f-1d44-4c13-948f-7aacba470f6a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:45.550437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:45.551106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.551390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.551667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.552373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:45.552681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:45.554096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:45.559436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 485/953] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:45.566130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:45.673496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8e2a-250b-43e9-b1e1-cb2b4c1cb853 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:45.709939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:45.710618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.710915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.711241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.712010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:45.712331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:45.713752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439e05-913b-421e-bc0b-074cae9f5e5e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:45.720239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 469/954] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:45.727045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:45.751960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:45.820578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c2cc7-97d1-45b7-8a87-e180dc9a97b7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.820873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c2cc7-97d1-45b7-8a87-e180dc9a97b7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.821165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c2cc7-97d1-45b7-8a87-e180dc9a97b7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.822992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 470/955] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:45.828790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.829087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.829406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.835795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399442cf-29b5-44c4-acf8-d2385adba255 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:45.847970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:45.849672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:45.870985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:45.871640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:45.871924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:45.872186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:45.873644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:45.875095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:45.894656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:45.931631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 471/956] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:45.953097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:46.005867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 486/957] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:46.067673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06573106-9b30-448d-a9ad-cda960ec210c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:46.115653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:46.116844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.117363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.117861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.118751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:46.120488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:46.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:46.135098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:46.135995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:46.139352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 472/958] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:46.145879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:46.232651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:46.269131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e0f5-9c97-4e59-8e86-7f87fec29cc9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:46.311092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:46.311778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.312070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.312358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.313105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:46.313451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:46.314877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d360c37-68de-4489-a271-c02a06ff8af3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:46.320373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 487/959] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:46.327471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:46.362215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:46.437703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbf345-337f-4a6f-b96e-26250756f6bc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:46.475380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:46.476077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.476396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.476681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.477422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:46.477739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:46.479146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff39d79-848b-4169-b40d-c429eb302193 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:46.484403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 473/960] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:46.495750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4eb3-b0da-4649-b2c9-0442fedc7255 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.496750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4eb3-b0da-4649-b2c9-0442fedc7255 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.497238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4eb3-b0da-4649-b2c9-0442fedc7255 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.499550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 488/961] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:46.505624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.506253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.506737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.525667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:46.527298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:46.615732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 474/962] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:46.642532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4eb3-b0da-4649-b2c9-0442fedc7255 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:46.772340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4eb3-b0da-4649-b2c9-0442fedc7255 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:46.814868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:46.816178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.816672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.817169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.827015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:46.830870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:46.839743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:46.840770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:46.841961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:46.844270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 489/963] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Jun 21 16:29:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:46.850388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:46.878091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:46.959743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ff54a-6607-4997-972b-fe5089ecceeb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:46.996333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:46.997018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:46.997324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:46.998163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:46.998951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:46.999268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.000695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.009802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 475/964] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:29:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:47.015753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.132273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1424821-ef66-4b1b-ba09-9801bbe61dc8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.168183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.169002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.169831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.170122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.182056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.183534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-97243ff2-414d-43f3-9d51-7f149f18abfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:47.203491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:47.204476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:47.205419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:47.205419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:47.205419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:47.205419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:47.205419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 490/965] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:47.211984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.241569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f96cd7-2086-4622-8a49-0c23d4d91cee None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.241893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f96cd7-2086-4622-8a49-0c23d4d91cee None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.242144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f96cd7-2086-4622-8a49-0c23d4d91cee None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.244772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 491/966] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:47.248950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf114e-3719-467f-8343-23d70647c634 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.249249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf114e-3719-467f-8343-23d70647c634 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.249563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf114e-3719-467f-8343-23d70647c634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.271369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-39bf114e-3719-467f-8343-23d70647c634 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:47.272697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-39bf114e-3719-467f-8343-23d70647c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:47.321022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:47.338471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a4bfa-1b14-4528-9937-6c42d004d49f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.349650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:47.375088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.376426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.377261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.377668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.378542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:47.379070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.379456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 492/967] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:47.385396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.398167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 476/968] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:47.403264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf114e-3719-467f-8343-23d70647c634 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.409725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.519146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51006601-365c-4c8a-9be8-6d4580365c4b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.531317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf114e-3719-467f-8343-23d70647c634 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.567044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.567854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.568199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.568492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.569353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.571216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.571994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.572540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING keystone.server.flask.common [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 16:29:47.573327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.573934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.574425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.582994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.584726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:47.600534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:47.601577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 16:29:47.602567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:47.608229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 493/969] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:47.609010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.625327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.sql.core [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 16:29:47.625327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 16:29:47.625327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [parameters: {'user_id': '63098980b12942ab859e446d80c47752', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 16:29:47.625327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80609) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application conn.query(q) Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result.read() Jun 21 16:29:47.632702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 16:29:47.633642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application next(self.gen) Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application yield resource Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application next(self.gen) Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise self.value Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application session.commit() Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 16:29:47.634613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.session.flush() Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application compat.raise_( Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 16:29:47.635601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 16:29:47.637563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application conn.query(q) Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application result.read() Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 16:29:47.640194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [parameters: {'user_id': '63098980b12942ab859e446d80c47752', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:47.642740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 16:29:47.645028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 477/970] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Jun 21 16:29:47 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:47.647337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.661271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:47.678630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:47.739751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc123-5fc6-4e1c-a8dc-00d3fedabc7f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.787828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10f7b-92f4-453b-a0a4-d672ab859071 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.789691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.791407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.791909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.792399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.793515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:47.794071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.796815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.825697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 494/971] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:47.827746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.829598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.830400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.830690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.830971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.839655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:47.841629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:47.856529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:47.858412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:47.859394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 478/972] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:47.869321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:47.941834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa576e4-6b58-4c39-ab24-6f9eea1a1b50 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:47.949611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:47.951891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:47.979412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faed608-bc1e-4416-be1a-00c80f68febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:47.980515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed608-bc1e-4416-be1a-00c80f68febb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:47.980952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed608-bc1e-4416-be1a-00c80f68febb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:47.982274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faed608-bc1e-4416-be1a-00c80f68febb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:47.991122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee2ed2-a6cf-4865-94af-dee53596e86b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.033801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.034482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.034771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.036988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.036988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:48.036988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.038489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.067527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faed608-bc1e-4416-be1a-00c80f68febb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.069333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faed608-bc1e-4416-be1a-00c80f68febb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.089366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 479/973] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:48.185441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:48.190626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 495/974] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:29:48.208539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.266684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c3a34-a3c5-4c44-b7ef-46e75ad05c12 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.266983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c3a34-a3c5-4c44-b7ef-46e75ad05c12 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.267245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c3a34-a3c5-4c44-b7ef-46e75ad05c12 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.268926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 496/975] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:48.274234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.274522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.274803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.294098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:48.296748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:48.330075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b474-dde5-4ab5-86df-0c2d83c2dcc0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.362662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:48.373080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.373961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.374249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.374581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.389392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 497/976] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:48.391835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.393457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.411654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:48.417351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:48.418232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:48.419152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:48.419152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:48.419152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:48.419152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:48.419152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 480/977] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:48.425556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.518875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97346-7101-4682-8331-fc62b0e79921 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.533712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ab05c-1c83-46b6-ae7a-0d02af47e3b2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.550898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:48.557053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.557900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.558189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.558581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.559393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.561071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.570910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.571584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.571874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.572154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.572883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:48.573197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:48.573770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:48.574790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:48.586187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:48.587040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.587116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 498/978] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:48.587116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.597579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 481/979] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:48.599573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.641048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:48.686848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73232b-6cad-466c-a630-14f33ae3c60b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.708679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1ddf3-ce61-40de-abd7-d4efbe4d0e06 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.722662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.723350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.723637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.723922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.724636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:48.724949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.726349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd434077-8328-4c5f-abc9-28a1f605a995 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.731005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 499/980] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:48.732297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bad92c-29ea-4ec8-ba3d-6d6ef5d0f3ef None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.732585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bad92c-29ea-4ec8-ba3d-6d6ef5d0f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.732868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bad92c-29ea-4ec8-ba3d-6d6ef5d0f3ef None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.734320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 500/981] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:48.736704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bad92c-29ea-4ec8-ba3d-6d6ef5d0f3ef None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.747973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.748907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.749195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.749511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.756508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.758012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-7368e9b7-ad1b-409d-973e-990a4f345e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:48.772833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:48.774017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:48.775122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:48.777420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 482/982] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:48.779705 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.780190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.780473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.797222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:48.797433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:48.798761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:48.843065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bad92c-29ea-4ec8-ba3d-6d6ef5d0f3ef None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.866207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 483/983] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:48.867073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.883298 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:48.884173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:48.884604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:48.885169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:48.886171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:48.886626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:48.888770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:48.894150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 501/984] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:48.895102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:48.901699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:48.973739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d087e8-4302-4a30-8d7b-4f24333ba60f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:48.995295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8df13-3f01-4216-8491-91c987e03693 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:49.007591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:49.008261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:49.008550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:49.008834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:49.009657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:49.009971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:49.011419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:49.018584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:49.023710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 484/985] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:49.024542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:49.030501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:49.031217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:49.031511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:49.031797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:49.032526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:49.033968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:49.112613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:49.124510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b085cd0-f132-47e9-a6c3-906167eb663f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:49.146458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 502/986] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:48 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:49.147293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:49.167191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:49.167874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:49.168155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:49.168427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:49.169759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] RBAC: Adding query filter params (interface=admin, service_id=aaa962f2cc7a4b8f8fabf2a75d994fce, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:49.170484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:49.171545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:49.182338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 485/987] 10.222.0.70 () {56 vars in 1249 bytes} [Tue Jun 21 16:29:49 2022] GET /identity/v3/endpoints?service_id=aaa962f2cc7a4b8f8fabf2a75d994fce&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:49.183900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:49.274829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d48aa-b183-4bd3-8d1a-b1bfbfc305e5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:49.305541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05066-d2fb-495c-95c7-84d9c3982c78 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:49.314398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:49.315061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:49.315349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:49.315623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:49.316471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] RBAC: Adding query filter params (role.id=0df32789fda94794a0731f80a867968e, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=2d8f0f57e4e8406dbab4cbcbe9836267) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:49.316786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:49.318259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a6e04-c4b1-4a24-aab9-f27ff23a94c2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:49.325241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 503/988] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:49 2022] GET /identity/v3/role_assignments?user.id=2d8f0f57e4e8406dbab4cbcbe9836267&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=0df32789fda94794a0731f80a867968e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:49.347163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcfcb5-94ec-4207-b94c-add6ba6296a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:49.347854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcfcb5-94ec-4207-b94c-add6ba6296a0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:49.348151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcfcb5-94ec-4207-b94c-add6ba6296a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:49.348415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcfcb5-94ec-4207-b94c-add6ba6296a0 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:49.349114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcfcb5-94ec-4207-b94c-add6ba6296a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:49.350755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcfcb5-94ec-4207-b94c-add6ba6296a0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:49.360281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 486/989] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:49 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:29:51.264722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c964-8d9e-4e93-a113-be5c5910c8d6 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.264722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c964-8d9e-4e93-a113-be5c5910c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.264722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c964-8d9e-4e93-a113-be5c5910c8d6 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.264722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 504/990] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:51.270295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bb460-87a1-4f52-93f2-2b781dac5074 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.270679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bb460-87a1-4f52-93f2-2b781dac5074 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.270850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bb460-87a1-4f52-93f2-2b781dac5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.288143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e95bb460-87a1-4f52-93f2-2b781dac5074 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:51.289365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e95bb460-87a1-4f52-93f2-2b781dac5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:51.297715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:51.361424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 487/991] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:51.382332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6c964-8d9e-4e93-a113-be5c5910c8d6 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.431662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c4f0-fdf4-4c4a-a19e-5bde72cdbb01 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.431956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c4f0-fdf4-4c4a-a19e-5bde72cdbb01 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.432243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c4f0-fdf4-4c4a-a19e-5bde72cdbb01 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.433696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 488/992] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:51.437342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003896-a49f-42fa-803e-4b1d1e1228f7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.437730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003896-a49f-42fa-803e-4b1d1e1228f7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.438019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4003896-a49f-42fa-803e-4b1d1e1228f7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.438397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:51.439599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 489/993] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:51.440546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b7d6-88ba-47ab-b5d8-4fdfa83bcf51 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.440873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b7d6-88ba-47ab-b5d8-4fdfa83bcf51 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.441189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b7d6-88ba-47ab-b5d8-4fdfa83bcf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.458295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-14d0b7d6-88ba-47ab-b5d8-4fdfa83bcf51 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:51.459534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-14d0b7d6-88ba-47ab-b5d8-4fdfa83bcf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:51.493931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6c964-8d9e-4e93-a113-be5c5910c8d6 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:51.527638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 490/994] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:51.529572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.529869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.530155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.534062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:51.534857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.535143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.535422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.536072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:51.537474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:51.549185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:51.550432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:51.552575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:51.553636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.554535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 505/995] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:51.555353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.623003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 491/996] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:51.623664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.625877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:51.659487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876000-5e59-4ff0-b837-20774405d2cb None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:51.670113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:51.696560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:51.697387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.697679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.697962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.698623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:51.699992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:51.713002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:51.714327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:29:51.715238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.720137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 506/997] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:51.720979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.729474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68069e03-1fb6-4cd0-816a-8d41b7fe7c5c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:51.763541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:51.764216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.764511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.764785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.765529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:51.765923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:51.767687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:51.772462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 492/998] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:51.773239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.821363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497827-718e-44a5-8e8d-5b562164ee8b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:51.843486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:51.854658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:51.855466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.855754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.856037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.856719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:51.858126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:51.870129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:51.871282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:51.872923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 507/999] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:51.874689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.879970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1565-c553-426a-87e0-41721b8a4dd6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:51.912925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:51.918191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:51.919059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:51.919418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:51.919704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:51.920470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] RBAC: Adding query filter params (name=image) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:51.920785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:51.922590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:51.927801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 493/1000] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:51.928739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:51.989950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d40e-0c3a-4fcd-a97e-2f73393853a6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.032204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.033022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.033474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.033766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.034621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:52.034931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.036317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.042184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 508/1001] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:52.043149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:52.054503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3f0f5-9b96-4373-8d90-c9c4bc227764 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.087765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:52.094054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.094797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.095157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.095532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.096322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:52.096709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.098212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.108263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 494/1002] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:52.108263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:52.159011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c89f-6126-46af-a759-d81ac1d69887 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.160713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:52.199029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.199812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.200654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.201046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.201813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] RBAC: Adding query filter params (type=image) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:52.202387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.204684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.209950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 509/1003] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:52.211113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:52.222081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167ca1-e4aa-46ad-8833-3bd39ccbff6a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.259298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.259986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.260272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.260557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.261426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] RBAC: Adding query filter params (interface=public, service_id=9baa6bb2adfa47f1a1a5542ba971854d, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:52.261754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.266325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.272112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 495/1004] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:52 2022] GET /identity/v3/endpoints?service_id=9baa6bb2adfa47f1a1a5542ba971854d&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:52.277850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:52.348586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0404-8524-44db-a1c4-4beefa7a245c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.357553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:52.394296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.394974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.395265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.395545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.396271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:52.396585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.397993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.403298 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 510/1005] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Jun 21 16:29:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:52.404163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0adbb-8a0c-4140-9be9-64c3859673ec None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.409816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:52.439381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:52.442760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99149fe-2bfd-40f0-bd7a-fa779186c673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.443794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99149fe-2bfd-40f0-bd7a-fa779186c673 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.444158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99149fe-2bfd-40f0-bd7a-fa779186c673 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.444447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99149fe-2bfd-40f0-bd7a-fa779186c673 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.445145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99149fe-2bfd-40f0-bd7a-fa779186c673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.446562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99149fe-2bfd-40f0-bd7a-fa779186c673 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.461327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 496/1006] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:52 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:29:52.516814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f25aa5-2bce-43ef-be41-d8af056981cd None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:52.554989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1d3a-3d8c-4a62-b968-3473f9c36815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:52.555671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1d3a-3d8c-4a62-b968-3473f9c36815 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:52.555962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1d3a-3d8c-4a62-b968-3473f9c36815 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:52.556248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1d3a-3d8c-4a62-b968-3473f9c36815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:52.557008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea1d3a-3d8c-4a62-b968-3473f9c36815 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:52.558458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea1d3a-3d8c-4a62-b968-3473f9c36815 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:52.868846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 511/1007] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:29:54.257263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20784e2-6f66-4b52-94ef-70feab67f4cb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.257820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20784e2-6f66-4b52-94ef-70feab67f4cb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.257903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20784e2-6f66-4b52-94ef-70feab67f4cb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.262420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 497/1008] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:54.270958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023144ef-6078-4ae7-ac46-36abf265a560 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.271443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023144ef-6078-4ae7-ac46-36abf265a560 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.271533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023144ef-6078-4ae7-ac46-36abf265a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.290035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-023144ef-6078-4ae7-ac46-36abf265a560 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:54.291234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-023144ef-6078-4ae7-ac46-36abf265a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:54.369561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 512/1009] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:54.393267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20784e2-6f66-4b52-94ef-70feab67f4cb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:54.488051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1644-5417-44a0-bb03-d2aaedb008b2 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.488340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1644-5417-44a0-bb03-d2aaedb008b2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.488624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1644-5417-44a0-bb03-d2aaedb008b2 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.490192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 513/1010] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:54.494930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.495225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.495509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.500389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20784e2-6f66-4b52-94ef-70feab67f4cb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:54.513043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:54.514335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:54.525191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:54.526881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:54.539629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:54.540291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.540578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.541162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.541651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:54.543015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:54.581665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 514/1011] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:54.605021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:54.677321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 498/1012] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:54 2022] POST /identity/v3/services => generated 242 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:29:54.708523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778915-27f4-4cce-917f-84edd98073bb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:54.755930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:54.756743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.757031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.757406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.758074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:54.759506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:54.772428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:54.773880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 16:29:54.775051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:54.777664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 515/1013] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:54.780567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:54.890832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2ed33-cd1e-4cd2-a739-1a9c1a038256 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:54.924374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:54.925049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.925362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.925672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.926385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:54.926700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:54.928096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99189b46-5226-4762-8f27-79f3761f03c1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:54.938209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 499/1014] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:54.939764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:54.941986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c61a59-de6f-4881-9130-49b0770991a5 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.942283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c61a59-de6f-4881-9130-49b0770991a5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.942570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c61a59-de6f-4881-9130-49b0770991a5 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.944909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 500/1015] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:54.949184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:54.949714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:54.950719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:54.950860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:54.968389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:54.969857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:55.022529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:55.047542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 501/1016] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:54 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:55.052046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acae01-bb5b-4a7a-9f2e-c21a31b217c4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:55.071498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:55.088647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:55.089340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:55.089633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:55.089918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:55.091202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:55.091202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:55.092859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:55.098403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 516/1017] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Jun 21 16:29:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:55.103598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:55.177413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:55.183945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9958f-ffaf-4a79-8470-6583181c58af None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:55.211091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436a40-8907-4446-8120-b1f5dd64a1f0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:55.226278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:55.227299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:55.227847 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:55.228127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:55.229320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:55.230765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:55.232421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 502/1018] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:55.238098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:55.249707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904c55c-7a5b-4cc7-af5c-5e534fbe2c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:55.250676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904c55c-7a5b-4cc7-af5c-5e534fbe2c69 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:55.251118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904c55c-7a5b-4cc7-af5c-5e534fbe2c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:55.251410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904c55c-7a5b-4cc7-af5c-5e534fbe2c69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:55.252150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904c55c-7a5b-4cc7-af5c-5e534fbe2c69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:55.253532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904c55c-7a5b-4cc7-af5c-5e534fbe2c69 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:55.290344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:55.343824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d59e-954f-4367-8a5b-f7c150ce26f9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:55.363255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 517/1019] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:29:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:29:55.398502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5d0d-db1a-4687-876d-0d6bad6fed57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:55.399183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5d0d-db1a-4687-876d-0d6bad6fed57 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:55.399470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5d0d-db1a-4687-876d-0d6bad6fed57 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:55.399749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5d0d-db1a-4687-876d-0d6bad6fed57 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:55.400725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5d0d-db1a-4687-876d-0d6bad6fed57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:55.402310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5d0d-db1a-4687-876d-0d6bad6fed57 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:55.538886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 503/1020] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:29:55 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:29:56.754782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3f9d0-d7ff-4abd-a83e-631d6ae84ef0 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:56.755287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3f9d0-d7ff-4abd-a83e-631d6ae84ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:56.755287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3f9d0-d7ff-4abd-a83e-631d6ae84ef0 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:56.756694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 518/1021] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:56.761935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:56.762462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:56.762608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:56.779800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:56.781001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:56.852997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 504/1022] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:29:56.877394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3f9d0-d7ff-4abd-a83e-631d6ae84ef0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:56.979691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3f9d0-d7ff-4abd-a83e-631d6ae84ef0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.004926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:57.014514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.015306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.015598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.015889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] PATH_INFO: `/v3/services/image` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.023454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:57.023454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:57.030233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:57.031353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:29:57.032216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:57.036518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 519/1023] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Jun 21 16:29:56 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:57.037829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.063533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:57.141418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee4c1d-36c6-40b8-b131-aa82df8f095c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.176415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.177088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.177406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.177691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.178405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] RBAC: Adding query filter params (name=image) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:57.178725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:57.180109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:57.191733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 505/1024] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:57.191926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.303961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4092f2-b0b7-417e-b46e-882f389dbf34 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.339198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.339860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.340136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.341184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.341920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] RBAC: Adding query filter params (type=image) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:57.342233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:57.343647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:57.353476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 520/1025] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:57.354445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.443076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:57.462617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7e65-0a4e-43ef-b1d5-4abf0a712eeb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.500301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.500975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.501267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.501578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.502380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] RBAC: Adding query filter params (interface=public, service_id=ebe8440f6c3d43da9209d58fe6c5b49b, region_id=RegionOne) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:57.502698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:57.504093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cca9d-fec3-434f-bb59-35ce8f63a2ae None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:57.513653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 506/1026] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/endpoints?service_id=ebe8440f6c3d43da9209d58fe6c5b49b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:57.515498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.543085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7de29-0371-4e19-88c0-cea734e00c48 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.544672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7de29-0371-4e19-88c0-cea734e00c48 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.544970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7de29-0371-4e19-88c0-cea734e00c48 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.546431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 507/1027] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:57.551759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f700-e482-474c-b1b8-864ba2a1b369 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.552051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f700-e482-474c-b1b8-864ba2a1b369 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.552330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f700-e482-474c-b1b8-864ba2a1b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.571824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a9a6f700-e482-474c-b1b8-864ba2a1b369 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:57.573001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a9a6f700-e482-474c-b1b8-864ba2a1b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:57.578781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:57.626832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd12de1-9e49-4595-bd54-431ff4b3eb90 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.644910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 508/1028] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:57.646241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157c27-420d-4848-9849-12cf6c41f7a7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.646530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157c27-420d-4848-9849-12cf6c41f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.646804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157c27-420d-4848-9849-12cf6c41f7a7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.648211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 509/1029] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:29:57.654004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.654292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.654573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.661240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.662167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.662640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.663125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.663992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:57.665699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:57.671748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:57.672956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:57.685304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 521/1030] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:29:57.685304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.753773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 510/1031] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:57.780717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.794256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:57.807926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995376-f00e-404e-a39d-349b2710e21f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.829484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:57.853302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.854133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.854416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.854682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.867164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:29:57.876060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:57.877245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:57.878282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 522/1032] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:57.883578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.906744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cc8c6-57ec-4f5b-99a1-8e12c1e62694 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:57.944683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:57.945677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:57.945969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:57.946245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:57.947434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:57.948895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:57.951054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 511/1033] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:57.956448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:57.996980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c7d7-6049-4001-8c54-0942b0155d66 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.036492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.037172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.037489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.037777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.038570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:58.038894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.040299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:58.049517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:58.054644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 523/1034] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:29:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:29:58.056160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:58.086044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b880d-70f4-44b8-b5d1-58a2e3ea862d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.102289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:58.125255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.126071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.126366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.126721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.127443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.128890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:58.163449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e4a0-ec44-44e5-8b37-dea111239f88 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.198499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.199290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.199853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.199853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.210785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.212262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:58.230058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:58.232288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:58.233563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:58.233563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:58.233563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:58.233563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:58.233563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 524/1035] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:58.237857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:58.253610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 512/1036] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:29:57 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:29:58.351012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:58.361542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12909-4b77-4fbf-b022-f03c1b3d4d07 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.399568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.400313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.400629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.400913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.401699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:58.402014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.404390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:58.417852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 525/1037] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:58.424872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:58.536517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27acff-0008-4c97-8c76-2fedb79569f7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.571641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.572428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.572709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.572985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.575409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:58.581586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.583052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:29:58.597959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:58.598943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:29:58.599911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 513/1038] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:29:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:58.605110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:58.709085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b395d88-1cd3-4526-bd2c-d564a97636c8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.744031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.744692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.744975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.745254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.746116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:58.746456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.748185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:58.771399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 526/1039] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:29:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:58.772756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:58.881813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b53c8-cb45-486b-9c49-9d899ae22c21 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:58.916120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:58.916774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:58.917062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:58.917374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:58.979517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:58.988190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:58.990450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:59.094224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 514/1040] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:29:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:29:59.095466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:59.108328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:59.195046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1ae2-2bcf-4e3c-b6ee-e409cc2f779d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:59.229659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:59.230447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.230824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.231094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.241522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:59.242970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:29:59.267149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:59.268093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:59.269012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:29:59.269012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:29:59.269012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:29:59.269012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:59.269012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 527/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:29:59.273704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:59.369913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:59.377826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ab5ba-931c-47e6-b779-c6bf5a11411b None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:59.417071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:59.418043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.418527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.419065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.420006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:59.420516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:59.422123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:59.438927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 515/1042] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:59.440496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:59.507591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:59.547138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3824-2a04-46d3-bf7c-36e9174dbb1c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:59.583106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:59.583903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.584192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.584472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.591710 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:59.593178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:29:59.607223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:29:59.608117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:29:59.609028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 528/1043] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:29:59.615413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:59.717004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38c34b-7652-4edd-9e0b-6efff907592f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:59.751489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:59.752224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.752443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.752726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.753542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:59.753859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:59.755299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e08488-e7c8-44a8-9da3-4be847be5c03 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:59.772399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 516/1044] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:29:59.773634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:59.797204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06c75-0b8d-4942-8e44-01085ff15238 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.797523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06c75-0b8d-4942-8e44-01085ff15238 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.797780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06c75-0b8d-4942-8e44-01085ff15238 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.799371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 517/1045] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:29:59.803915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.804206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.804485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.822293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:29:59.823465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:29:59.833419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:59.879369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702f9dc-2150-4df0-b8b1-33fe50ad8de3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:29:59.895996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 518/1046] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:29:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:29:59.905418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:29:59.917017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:29:59.917757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:29:59.918056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:29:59.919235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:29:59.920211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:29:59.922103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] RBAC: Adding query filter params (role.id=0df32789fda94794a0731f80a867968e, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=9687c85240694148aa572d8807ada25b) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:29:59.922751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:29:59.925057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:29:59.931383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 529/1047] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:29:59 2022] GET /identity/v3/role_assignments?user.id=9687c85240694148aa572d8807ada25b&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=0df32789fda94794a0731f80a867968e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:00.042906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9a108-2ff2-41e8-a2f9-07f63aa28fd1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:00.082082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:00.082882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.083168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.083449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.084120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:00.085551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:00.099236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:00.100282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:00.101133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 519/1048] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Jun 21 16:29:59 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:00.107221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:00.209749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054766f-5040-4173-b1e1-1acb01ea78da None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:00.244891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:00.245596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.245886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.246191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.247156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] RBAC: Adding query filter params (name=image) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:00.247470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:00.248860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:00.253800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 530/1049] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:00.259740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:00.272859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:00.367465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2c965-80b9-40bc-b64e-c399f148c8e7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:00.403751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:00.404493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.404782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.405063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.405946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] RBAC: Adding query filter params (type=image) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:00.406264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:00.407669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f68b6-a900-4752-a6de-9b51fd782890 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:00.417465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 520/1050] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:00.419566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:00.451468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f9ca-0d90-4cac-87bf-e8fb76d082fb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.451778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f9ca-0d90-4cac-87bf-e8fb76d082fb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.452038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f9ca-0d90-4cac-87bf-e8fb76d082fb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.454798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 521/1051] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:00.460088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.460386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.460676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.474178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:00.477887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:00.479090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:00.531312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f0ae-84ff-4e35-8569-5f044530b40b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:00.550147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 522/1052] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:00.571712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:00.572378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.572667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.572948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.573723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:00.575442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:00.576970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:00.578170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:00.676070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4bd1-506a-4c7e-b788-7e8883f9bb0a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:00.711832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:00.712634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.712927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.713210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.714233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 531/1053] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:30:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:30:00.725209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:00.733853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:00.738379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:00.739244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 523/1054] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:00.747219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:00.866017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa220f-7d0e-4185-93ae-6cc79babdafc None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:00.867648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:00.900802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:00.901510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:00.901805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:00.902119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:00.903904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:00.903904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:00.905221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:00.914802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 532/1055] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:00.921129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:00.986462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:01.025667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01f471-dd0a-4f43-b523-9c1d48439ea6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:01.063256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:01.064162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:01.064453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:01.064736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] PATH_INFO: `/v3/users/de635f40f8164b519f1e7d10be1afb68` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:01.080569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=de635f40f8164b519f1e7d10be1afb68)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:01.082086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:01.084030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 524/1056] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:00 2022] GET /identity/v3/users/de635f40f8164b519f1e7d10be1afb68 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:01.089448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:01.193248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea814-6ddb-46db-a12e-10b250f2ffa5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:01.227884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:01.228901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:01.229430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:01.229930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:01.271890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:01.306827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:01.308310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:01.410662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 533/1057] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 16:30:01.415447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:01.517064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52177f12-63cd-4b23-9f35-12162ef0e3a9 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:01.537329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:01.552074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4e248-41ab-4105-8fb9-2b6ef83ed5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:01.553012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4e248-41ab-4105-8fb9-2b6ef83ed5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:01.557419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4e248-41ab-4105-8fb9-2b6ef83ed5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:01.557419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4e248-41ab-4105-8fb9-2b6ef83ed5d7 None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:01.557419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4e248-41ab-4105-8fb9-2b6ef83ed5d7 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d12222030940bea554198e4ac2b4f8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:01.557419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4e248-41ab-4105-8fb9-2b6ef83ed5d7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:01.564063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 525/1058] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:01 2022] GET /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:01.565323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:01.627434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:01.664218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc339a2-ee1e-4228-9979-53d03ccd7457 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:01.698504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:01.699186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:01.699495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:01.699760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:01.700795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=b7d12222030940bea554198e4ac2b4f8, user.id=de635f40f8164b519f1e7d10be1afb68) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:01.701116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:01.702644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c6b9-4119-4716-8c05-10081bbeaf88 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:01.717397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 534/1059] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:01 2022] GET /identity/v3/role_assignments?user.id=de635f40f8164b519f1e7d10be1afb68&scope.project.id=b7d12222030940bea554198e4ac2b4f8&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:02.032710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2726159-06c1-4020-9a4a-543e5fef11b6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.033515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2726159-06c1-4020-9a4a-543e5fef11b6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.033515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2726159-06c1-4020-9a4a-543e5fef11b6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.034960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 526/1060] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:02.040103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.040400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.040684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.058064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:02.059812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:02.133736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 535/1061] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:02.158300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2726159-06c1-4020-9a4a-543e5fef11b6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:02.270599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2726159-06c1-4020-9a4a-543e5fef11b6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:02.319641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:02.319641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.319641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.319641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.320775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:02.329651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:02.330692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:30:02.332038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:02.333664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 527/1062] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Jun 21 16:30:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:02.337205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:02.398046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:02.442139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e966-0aff-45d8-8976-7aaee1930050 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:02.478269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:02.478942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.479225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.479497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.480236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:02.481829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:02.483208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:02.496004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 536/1063] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:30:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:02.497317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:02.547913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:02.600450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c9d9-ba6e-4b39-abfa-93ca70626d79 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:02.635169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:02.635962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.636271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.636564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.647608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:02.649069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-08825184-6ce0-4745-a7a3-26b42350cf1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:30:02.666760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:02.667685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:02.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:30:02.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:30:02.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:02.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:02.674421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 528/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:02.675283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:02.780925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f471491-539d-4dca-a84a-0354dd24b557 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:02.801314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:02.818246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:02.818981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.819274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.819558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.820295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:02.820619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:02.822017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:02.827448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffcdbb-5502-4631-bf48-3910fc5762c3 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.827737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffcdbb-5502-4631-bf48-3910fc5762c3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.828001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffcdbb-5502-4631-bf48-3910fc5762c3 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.829445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 529/1065] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:30:02.834727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.835129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.835511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.842075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 537/1066] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:02.843081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:02.853686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:02.855099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:02.925212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 530/1067] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:30:02.946877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:02.948480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1c19-cc39-454a-819e-5aa1c939ab1e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:02.976835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:02.987635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:02.992047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:02.992047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:02.992047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:02.997416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:02.999013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:30:03.013863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:03.015019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:03.015975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 538/1068] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:30:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:03.021424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.050872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12239356-8485-459d-a094-bb1d31bdf86e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.062546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.091742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.092723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.093012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.093316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.123266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ea4a7-e9fd-4287-87fd-7f65f71421f8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.158151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.158819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.159105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.159386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.160221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:03.160536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.162034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.174179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.175636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.185748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 539/1069] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:03.187137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.209325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.291876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.294538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 531/1070] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 16:30:03.300803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.306576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ab88-066b-4364-a596-2df58121c5f7 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.343767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.344710 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.345055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.345422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.357863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.359318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:30:03.378070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:03.379036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:03.379947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:30:03.379947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:30:03.379947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:03.379947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:03.379947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 540/1071] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:03.384841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.413591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206cc53-4b1a-453f-b1ea-9f4f8bf2f6ff None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.446284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.452759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.453595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.453890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.454206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.464239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.466627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:30:03.484640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:03.485888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:03.492024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:30:03.492024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:30:03.492024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:03.492024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:03.492024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 532/1072] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:03.493803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.501914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b69c-50c6-48c4-9a01-af39e2a6de7b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.538815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.539476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.539761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.540040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.540755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:03.541064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.542461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.559379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 541/1073] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:03.560445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.575365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.605041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747007-7e19-4c7f-9a7d-f4deac16751e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.643587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.644642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.645255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.645728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.647369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:03.647851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.649453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.664895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 533/1074] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:03.678415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107722cd-fa73-49f9-b8a8-4d1a17f1d1f9 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.718080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.718903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.719190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.719470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.727513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.728982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-70858b5e-c17d-4ab5-8c5a-d4af24c8d36d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:30:03.744706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:03.745770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:30:03.747392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:03.748484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 542/1075] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:03.752634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.761148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2a88-22eb-4801-aac2-d952e49c0cd8 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.761472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2a88-22eb-4801-aac2-d952e49c0cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.762337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2a88-22eb-4801-aac2-d952e49c0cd8 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.765325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 543/1076] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:30:03.769496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.770069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.770069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.789076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:03.790355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:03.803914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.865794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:03.872368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 544/1077] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:30:03.878114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c39f60-af71-4771-a522-e2272c81f21a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:03.897174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:03.924757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:03.926770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:03.927065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:03.927346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:03.928151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:03.928469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:03.929984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:03.945316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 534/1078] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:03.951713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:04.010492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cce44e-3b80-46aa-bb52-6bfdd6fedcc7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:04.046541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:04.047987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:04.047987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:04.048214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:04.053327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914800-6160-4358-9c22-9ac6af8035e0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:04.054887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:04.059142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:04.066728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:04.070612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:04.071741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 545/1079] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:04.073887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:04.093537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:04.094432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:04.094712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:04.094990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/9687c85240694148aa572d8807ada25b/roles/0df32789fda94794a0731f80a867968e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:04.097177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=9687c85240694148aa572d8807ada25b, role_id=0df32789fda94794a0731f80a867968e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:04.098653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:04.137426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:04.167415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 535/1080] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:30:03 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/9687c85240694148aa572d8807ada25b/roles/0df32789fda94794a0731f80a867968e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:30:04.177815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2790e38-a285-47ae-9c4e-2e2835bd6dc4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:04.215719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:04.216308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:04.216596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:04.216877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:04.217708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:04.218008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:04.219459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:04.229160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 546/1081] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:04.236393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:04.350835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4109c-51fb-485c-bd57-02301156f35e None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:04.386177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:04.387608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:04.387891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:04.388173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] PATH_INFO: `/v3/users/de635f40f8164b519f1e7d10be1afb68` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:04.389386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] RBAC: Authorizing `identity:get_user(user_id=de635f40f8164b519f1e7d10be1afb68)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:04.390836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:04.392528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 536/1082] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:04 2022] GET /identity/v3/users/de635f40f8164b519f1e7d10be1afb68 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:04.398445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:04.510148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0e442-9df8-49f2-a946-93d8d79f3add None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:04.533712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:04.547185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b54277-4d75-40ed-80f4-d5218d414e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:04.548051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b54277-4d75-40ed-80f4-d5218d414e52 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:04.548344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b54277-4d75-40ed-80f4-d5218d414e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:04.548626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b54277-4d75-40ed-80f4-d5218d414e52 None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:04.549856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b54277-4d75-40ed-80f4-d5218d414e52 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d12222030940bea554198e4ac2b4f8)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:04.551430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b54277-4d75-40ed-80f4-d5218d414e52 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:04.553185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 547/1083] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:04 2022] GET /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:04.559791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:04.593395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:04.673920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0e8e-bfef-48c6-8103-fec61bd83f6a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:04.708178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59b5f6-e1f8-4371-94e6-584b6c9402f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:04.709063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b5f6-e1f8-4371-94e6-584b6c9402f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:04.709382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b5f6-e1f8-4371-94e6-584b6c9402f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:04.709662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b5f6-e1f8-4371-94e6-584b6c9402f6 None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8/users/de635f40f8164b519f1e7d10be1afb68/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:04.711610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59b5f6-e1f8-4371-94e6-584b6c9402f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7d12222030940bea554198e4ac2b4f8, user_id=de635f40f8164b519f1e7d10be1afb68, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:04.713043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59b5f6-e1f8-4371-94e6-584b6c9402f6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:04.807113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 537/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:30:04 2022] PUT /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8/users/de635f40f8164b519f1e7d10be1afb68/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:30:06.241811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc460458-a0bd-4eec-be49-e37d2d90aa0c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.242394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc460458-a0bd-4eec-be49-e37d2d90aa0c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.242394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc460458-a0bd-4eec-be49-e37d2d90aa0c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.243765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 548/1085] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:06.249747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.250172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.250445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.270301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:06.271503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:06.338046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 538/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:06.362404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc460458-a0bd-4eec-be49-e37d2d90aa0c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:06.482229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc460458-a0bd-4eec-be49-e37d2d90aa0c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:06.516665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:06.517499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.517789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.518071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.528241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:06.536456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:06.537652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 16:30:06.538739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:06.541446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 549/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Jun 21 16:30:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:06.544262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:06.566039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:06.645221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d51bb-69df-4dc4-bcb3-2635b3285f03 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:06.678412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:06.679084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.679374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.679665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.680411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:06.680726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:06.682142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099bd6b-a65b-4bed-b4ec-a836862c4932 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:06.690305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 539/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:30:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:06.695988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:06.746513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:06.797456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd8214-34ef-468b-8bcb-2c12ddb8cd46 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:06.832011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:06.832808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.833096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.833408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.844435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:06.845950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:30:06.863339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:06.864439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:06.865366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:30:06.865366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:30:06.865366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:06.865366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:06.865676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77c2a-9e0b-4749-9989-48d8b793cc38 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.865676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77c2a-9e0b-4749-9989-48d8b793cc38 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.865837 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 550/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:06.865933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77c2a-9e0b-4749-9989-48d8b793cc38 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.866019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 540/1090] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:30:06.870083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:06.871213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:06.871498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:06.871796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:06.888543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:06.889776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:06.956988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 541/1091] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:30:06.971597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c1d1-5786-4cae-b7e9-157eb6c96565 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:06.973116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:06.981336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:06.995258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.006654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.007316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.007604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.007887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.008629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:07.009126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.010648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.039404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 551/1092] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:07.044642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.109982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda388b-5486-4ebb-a66e-2cbe58c178a4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.146172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.147112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.147223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.147472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.157080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a9e70-e0ea-4b9a-896d-8faa5651f55b None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.158789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:07.166385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:07.167498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:07.169006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 542/1093] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:07.175160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.196323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.197329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.197446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.198118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.207294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.208742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:30:07.225457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:07.226496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:07.227451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 552/1094] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:07.233040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.267703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.269613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.298020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be0e8a-3ec6-47c5-b640-332bfbc8c6ad None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.333904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.334611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.334906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.335192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.335951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:07.336266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.337688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.347537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 543/1095] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:07.353706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.356106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4d92e-dea2-417d-b8ca-43d246da9c90 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.397464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.398067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.398347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.398626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.399463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:07.399773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.401200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.419944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 553/1096] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:07.425586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.460711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3665c-1614-4037-b9d1-1ec903ebbe2d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.494792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.495713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.496008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.496285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] PATH_INFO: `/v3/users/de635f40f8164b519f1e7d10be1afb68` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.497543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] RBAC: Authorizing `identity:get_user(user_id=de635f40f8164b519f1e7d10be1afb68)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.498998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.500692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 544/1097] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/users/de635f40f8164b519f1e7d10be1afb68 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:07.505112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.506552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.509254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.524863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b0115-3301-4dec-9799-ab910d3db035 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.561004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.561678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.561962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.562245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.607124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff32e2-b4c3-454b-9485-b82d44aa6092 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.630495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.631963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.642874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.643832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.643832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.644132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.711367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.711612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.713079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.715378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.730416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 554/1098] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 16:30:07.736372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.811031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 545/1099] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 16:30:07.816752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.835631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ff729-ce8f-496a-8c24-c7e090ede734 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.869449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.870281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.871311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.871633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.881692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.883181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:30:07.901297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:07.902437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:07.903465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:30:07.903465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:30:07.903465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:30:07.903465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:07.903465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 555/1100] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:07.909308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:07.919131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c264b20-7be8-4a26-a296-151e5f3ee756 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:07.920659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.940368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:07.954196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:07.955062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:07.955347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:07.955634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:07.956808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d12222030940bea554198e4ac2b4f8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:07.958286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:07.965484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 546/1101] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:07.966436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:08.008809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13742-6d9b-4158-96c2-a8f7ef7cdcd3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:08.044074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:08.044734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:08.045019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:08.045326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:08.046049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:08.046360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:08.047840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:08.060162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 556/1102] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:08.065706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8873e-a5b5-4289-910c-9cd453a84ce2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:08.065866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:08.099482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:08.100134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:08.100421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:08.100703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:08.101556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=b7d12222030940bea554198e4ac2b4f8, user.id=de635f40f8164b519f1e7d10be1afb68) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:08.101874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:08.103303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:08.111152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 547/1103] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:07 2022] GET /identity/v3/role_assignments?user.id=de635f40f8164b519f1e7d10be1afb68&scope.project.id=b7d12222030940bea554198e4ac2b4f8&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:08.163045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:08.172898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabfebb-e10c-4032-8d71-1d0e4a65601f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:08.209223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:08.210065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:08.210352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:08.210634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:08.219326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:08.220474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:30:08.235645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:08.236645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:08.237729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 557/1104] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:30:08.242995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:08.282579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:08.350318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750e6ad-20fd-48fc-a049-c4d217611d82 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:08.384369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:08.385039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:08.385359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:08.385644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:08.386778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:08.387184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:08.388641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1132c-e440-4716-9186-2675d7033bb4 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:08.400340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 548/1105] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:08.407157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:08.507583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520914c5-ddc3-478d-a969-f357a56e6fda None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:08.541871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:08.543173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:08.543623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:08.543820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:08.544653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] RBAC: Adding query filter params (role.id=0df32789fda94794a0731f80a867968e, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=9687c85240694148aa572d8807ada25b) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:08.544973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:08.546582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766086b1-2971-4551-98db-34d57d2634ee None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:08.552585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 558/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:08 2022] GET /identity/v3/role_assignments?user.id=9687c85240694148aa572d8807ada25b&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=0df32789fda94794a0731f80a867968e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:10.182753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd92b7-2fc5-4389-a60f-cef2aeae4bbd None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:10.183297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd92b7-2fc5-4389-a60f-cef2aeae4bbd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:10.183297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd92b7-2fc5-4389-a60f-cef2aeae4bbd None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:10.184731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 549/1107] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:10.190341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:10.190771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:10.190912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:10.207690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:10.208929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:10.219764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:10.278650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 559/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:10.304084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd92b7-2fc5-4389-a60f-cef2aeae4bbd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:10.397807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:10.405476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd92b7-2fc5-4389-a60f-cef2aeae4bbd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:10.440285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437d5c-de66-4e3c-a990-f572c997d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:10.441006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437d5c-de66-4e3c-a990-f572c997d3cf None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:10.441316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437d5c-de66-4e3c-a990-f572c997d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:10.441605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437d5c-de66-4e3c-a990-f572c997d3cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:10.442781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437d5c-de66-4e3c-a990-f572c997d3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:10.444226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437d5c-de66-4e3c-a990-f572c997d3cf None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:10.445906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 550/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:10.451750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:10.550174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242741dc-5e09-48f5-b530-67a0572ff8e0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:10.583108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb89b-f2d4-4f8c-946e-c7f089774023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:10.583765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb89b-f2d4-4f8c-946e-c7f089774023 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:10.584054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb89b-f2d4-4f8c-946e-c7f089774023 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:10.584334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb89b-f2d4-4f8c-946e-c7f089774023 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:10.585090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb89b-f2d4-4f8c-946e-c7f089774023 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:10.586570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb89b-f2d4-4f8c-946e-c7f089774023 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:10.673610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 560/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:30:10 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:30:12.753222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa6d0d-5039-48e4-a120-2af4b0c2c5de None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:12.753773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa6d0d-5039-48e4-a120-2af4b0c2c5de None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:12.753773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa6d0d-5039-48e4-a120-2af4b0c2c5de None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:12.755119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 551/1111] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:12.760224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:12.760669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:12.760787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:12.765813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:12.786068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:12.787304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:12.860463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 561/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:12.884852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa6d0d-5039-48e4-a120-2af4b0c2c5de None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:12.989161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa6d0d-5039-48e4-a120-2af4b0c2c5de None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:13.023564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:13.024379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:13.024664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:13.024946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] PATH_INFO: `/v3/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:13.027012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] RBAC: Authorizing `identity:get_role(role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:13.028477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:13.029940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 552/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:12 2022] GET /identity/v3/roles/3ad4a86440e943caac11daabeeb44957 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:13.035897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:13.132526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49185-cdd9-4cd2-b786-abb1306a7083 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:13.160960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:13.165760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:13.166617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:13.166975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:13.167777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] PATH_INFO: `/v3/users/041336a427494f9ca420b5eef22a53fd` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:13.180316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] RBAC: Authorizing `identity:get_user(user_id=041336a427494f9ca420b5eef22a53fd)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:13.181785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:13.183482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 562/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:13 2022] GET /identity/v3/users/041336a427494f9ca420b5eef22a53fd => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:13.189457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:13.220206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:13.290033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c9ec-88ae-4e3f-bf55-e35e6f27fe83 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:13.323786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:13.324428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:13.324715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:13.325000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:13.391715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:13.393172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:13.421572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:13.490504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 553/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:13.497545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:13.598540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff4c7-b453-4cd1-beca-c9a8fdec5d1f None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:13.632253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17861cb-d94c-4eb1-8b8c-3365095f76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:13.633100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17861cb-d94c-4eb1-8b8c-3365095f76b1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:13.633412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17861cb-d94c-4eb1-8b8c-3365095f76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:13.633694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17861cb-d94c-4eb1-8b8c-3365095f76b1 None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:13.634854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17861cb-d94c-4eb1-8b8c-3365095f76b1 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d12222030940bea554198e4ac2b4f8)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:13.637416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17861cb-d94c-4eb1-8b8c-3365095f76b1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:13.639133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 563/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:13 2022] GET /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:13.645488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:13.742796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd69786-4930-4f72-a5a8-d4e27be88ccc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:13.771516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:13.777544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:13.778224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:13.778513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:13.778795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:13.779642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] RBAC: Adding query filter params (role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=b7d12222030940bea554198e4ac2b4f8, user.id=041336a427494f9ca420b5eef22a53fd) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:13.780000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:13.781489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4699e-dbf5-4935-b0ec-4c4e9df0916b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:13.786922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 554/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:13 2022] GET /identity/v3/role_assignments?user.id=041336a427494f9ca420b5eef22a53fd&scope.project.id=b7d12222030940bea554198e4ac2b4f8&role.id=3ad4a86440e943caac11daabeeb44957 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:15.803591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36343c-3caa-47cc-aae8-704297eefdeb None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:15.804138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36343c-3caa-47cc-aae8-704297eefdeb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:15.804138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36343c-3caa-47cc-aae8-704297eefdeb None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:15.805590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 564/1118] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:15.811580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:15.811971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:15.812150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:15.828712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:15.829944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:15.897484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 555/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:15.921642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36343c-3caa-47cc-aae8-704297eefdeb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:15.980330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:16.024812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36343c-3caa-47cc-aae8-704297eefdeb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:16.061907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:16.062674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:16.062959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:16.063237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] PATH_INFO: `/v3/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:16.064836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] RBAC: Authorizing `identity:get_role(role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:16.066281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:16.067695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 565/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:15 2022] GET /identity/v3/roles/3ad4a86440e943caac11daabeeb44957 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:16.073718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:16.172124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d231bd-fa24-4a08-b395-f62a73bd1786 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:16.194652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:16.205822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:16.206690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:16.206968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:16.207244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] PATH_INFO: `/v3/users/041336a427494f9ca420b5eef22a53fd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:16.208404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] RBAC: Authorizing `identity:get_user(user_id=041336a427494f9ca420b5eef22a53fd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:16.209871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:16.211525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 556/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:16 2022] GET /identity/v3/users/041336a427494f9ca420b5eef22a53fd => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:16.218716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:16.318923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b40f3-5b36-43a0-9a0f-69e1852a8d13 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:16.345479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:16.353629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058d54-daad-4c93-a9ce-e16e323037d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:16.355087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058d54-daad-4c93-a9ce-e16e323037d6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:16.355372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058d54-daad-4c93-a9ce-e16e323037d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:16.355649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058d54-daad-4c93-a9ce-e16e323037d6 None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:16.356850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54058d54-daad-4c93-a9ce-e16e323037d6 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d12222030940bea554198e4ac2b4f8)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:16.358300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54058d54-daad-4c93-a9ce-e16e323037d6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:16.360031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 566/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:16 2022] GET /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:16.366058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:16.467793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87709-7df4-42fd-872d-869ff85161b3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:16.500604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfbbf1-ea30-45c0-af14-08a0e3a6c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:16.501512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbbf1-ea30-45c0-af14-08a0e3a6c8da None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:16.501802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbbf1-ea30-45c0-af14-08a0e3a6c8da None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:16.502083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbbf1-ea30-45c0-af14-08a0e3a6c8da None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8/users/041336a427494f9ca420b5eef22a53fd/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:16.504321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfbbf1-ea30-45c0-af14-08a0e3a6c8da None admin] RBAC: Authorizing `identity:create_grant(project_id=b7d12222030940bea554198e4ac2b4f8, user_id=041336a427494f9ca420b5eef22a53fd, role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:16.505798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfbbf1-ea30-45c0-af14-08a0e3a6c8da None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:16.612064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 557/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:30:16 2022] PUT /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8/users/041336a427494f9ca420b5eef22a53fd/roles/3ad4a86440e943caac11daabeeb44957 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:30:18.631657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5586-e32e-49af-9233-9f3655b521e9 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:18.632191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5586-e32e-49af-9233-9f3655b521e9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:18.632191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5586-e32e-49af-9233-9f3655b521e9 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:18.633809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 567/1124] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:18.639217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:18.639622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:18.639795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:18.660334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:18.661577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:18.712180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:18.732994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 558/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:18.756961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5586-e32e-49af-9233-9f3655b521e9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:18.872470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5586-e32e-49af-9233-9f3655b521e9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:18.912022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:18.913399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:18.913897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:18.914365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] PATH_INFO: `/v3/roles/3ad4a86440e943caac11daabeeb44957` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:18.916852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] RBAC: Authorizing `identity:get_role(role_id=3ad4a86440e943caac11daabeeb44957)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:18.918987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:18.925377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 568/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:18 2022] GET /identity/v3/roles/3ad4a86440e943caac11daabeeb44957 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:18.927237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:19.034033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892fab2-282c-46fe-ba43-3eb651434b7f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:19.067347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:19.068216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:19.068503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:19.068786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] PATH_INFO: `/v3/users/041336a427494f9ca420b5eef22a53fd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:19.069983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] RBAC: Authorizing `identity:get_user(user_id=041336a427494f9ca420b5eef22a53fd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:19.071440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:19.073869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 559/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:18 2022] GET /identity/v3/users/041336a427494f9ca420b5eef22a53fd => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:19.079928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:19.144017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:19.187439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb3406-bc45-48ca-b017-90d4c50d98f3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:19.220847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:19.221531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:19.221854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:19.222139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:19.289297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:19.290813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:19.349432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:19.389574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 569/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:19.395519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:19.445185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:19.495180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a5165-6c3c-4d09-a3f6-6d94dadaa059 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:19.529598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ecc7c-0b97-429a-9344-0bf4bf69222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:19.530462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ecc7c-0b97-429a-9344-0bf4bf69222e None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:19.530753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ecc7c-0b97-429a-9344-0bf4bf69222e None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:19.531039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ecc7c-0b97-429a-9344-0bf4bf69222e None admin] PATH_INFO: `/v3/projects/b7d12222030940bea554198e4ac2b4f8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:19.532217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ecc7c-0b97-429a-9344-0bf4bf69222e None admin] RBAC: Authorizing `identity:get_project(project_id=b7d12222030940bea554198e4ac2b4f8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:19.533718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ecc7c-0b97-429a-9344-0bf4bf69222e None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:19.535450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 560/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:19 2022] GET /identity/v3/projects/b7d12222030940bea554198e4ac2b4f8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:19.541777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:19.639178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413145a0-a936-4007-843d-e58dbbb29b35 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:19.671831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:19.672476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:19.672764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:19.673044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:19.673909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] RBAC: Adding query filter params (role.id=3ad4a86440e943caac11daabeeb44957, scope.project.id=b7d12222030940bea554198e4ac2b4f8, user.id=041336a427494f9ca420b5eef22a53fd) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:19.674225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:19.675661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e328bd-726c-4ba2-bbd4-721f363acb3c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:19.681419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 570/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:19 2022] GET /identity/v3/role_assignments?user.id=041336a427494f9ca420b5eef22a53fd&scope.project.id=b7d12222030940bea554198e4ac2b4f8&role.id=3ad4a86440e943caac11daabeeb44957 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:21.769462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5e0e0-5cb7-4c2e-aa58-91e0532189b0 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:21.770064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5e0e0-5cb7-4c2e-aa58-91e0532189b0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:21.770064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5e0e0-5cb7-4c2e-aa58-91e0532189b0 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:21.771441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 561/1131] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:21.776796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:21.777251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:21.777381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:21.794944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:21.796126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:21.816167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:21.862337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 571/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:21.887051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5e0e0-5cb7-4c2e-aa58-91e0532189b0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:21.988762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5e0e0-5cb7-4c2e-aa58-91e0532189b0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:22.006453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:22.024132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf3bc3-866f-43bb-af76-f65815ecdac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:22.024852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3bc3-866f-43bb-af76-f65815ecdac8 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:22.025135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3bc3-866f-43bb-af76-f65815ecdac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:22.026020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3bc3-866f-43bb-af76-f65815ecdac8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:22.027614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf3bc3-866f-43bb-af76-f65815ecdac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:22.029058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf3bc3-866f-43bb-af76-f65815ecdac8 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:22.030831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 562/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:22.036694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:22.133659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee821f3b-a75b-4553-a31e-a055425df0fb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:22.166877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c46d-7baf-4bd3-9f2f-61e6e81453ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:22.167523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c46d-7baf-4bd3-9f2f-61e6e81453ff None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:22.167812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c46d-7baf-4bd3-9f2f-61e6e81453ff None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:22.168093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c46d-7baf-4bd3-9f2f-61e6e81453ff None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:22.168801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23c46d-7baf-4bd3-9f2f-61e6e81453ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:22.170269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23c46d-7baf-4bd3-9f2f-61e6e81453ff None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:22.283467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 572/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:30:22 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:30:24.374593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b147fd5-874c-48ed-93f1-8a3d8f452247 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:24.375167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b147fd5-874c-48ed-93f1-8a3d8f452247 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:24.375167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b147fd5-874c-48ed-93f1-8a3d8f452247 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:24.376582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 563/1135] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:24.382143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:24.382599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:24.382692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:24.399629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:24.401461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:24.403586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:24.473304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 573/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:24.498852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b147fd5-874c-48ed-93f1-8a3d8f452247 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:24.602397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b147fd5-874c-48ed-93f1-8a3d8f452247 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:24.637422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56f45-ed74-4aa5-aa76-61f40507f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:24.638218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56f45-ed74-4aa5-aa76-61f40507f427 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:24.638506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56f45-ed74-4aa5-aa76-61f40507f427 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:24.638786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56f45-ed74-4aa5-aa76-61f40507f427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:24.639960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56f45-ed74-4aa5-aa76-61f40507f427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:24.641505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56f45-ed74-4aa5-aa76-61f40507f427 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:24.643183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 564/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:24.649033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:24.750105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3859e-2dbb-40a1-8d3a-68a2da8c8a08 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:24.785226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ab9c1-453c-4892-845c-fe6013c4f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:24.785929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ab9c1-453c-4892-845c-fe6013c4f5a6 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:24.786217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ab9c1-453c-4892-845c-fe6013c4f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:24.786499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ab9c1-453c-4892-845c-fe6013c4f5a6 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:24.787222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ab9c1-453c-4892-845c-fe6013c4f5a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:24.788651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ab9c1-453c-4892-845c-fe6013c4f5a6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:24.797488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:24.955206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 574/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:30:24 2022] POST /identity/v3/users => generated 286 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:30:27.034259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058c786-f488-4535-847e-2cc509b13ea1 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:27.034815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058c786-f488-4535-847e-2cc509b13ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:27.034815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058c786-f488-4535-847e-2cc509b13ea1 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:27.036303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 565/1139] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:27.041975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:27.042387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:27.042538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:27.059585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:27.060769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:27.126834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 575/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:27.151622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058c786-f488-4535-847e-2cc509b13ea1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:27.207569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:27.251406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058c786-f488-4535-847e-2cc509b13ea1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:27.284946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:27.285715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:27.286005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:27.286288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:27.297161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:27.304992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:27.306136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:27.307296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 566/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:27.312351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:27.411094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d6c5-f00d-4ce9-965d-d5bc74ab7a5f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:27.434124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:27.444241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:27.444903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:27.445191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:27.445511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:27.446258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:27.446569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:27.448468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:27.456202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 576/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:27.461970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:27.564546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84713c75-1c0c-409b-9c07-6ee0fa25fe37 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:27.579133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:27.601049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:27.601961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:27.602250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:27.602530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] PATH_INFO: `/v3/users/dcaee547a4084147ad0c79f8261556a3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:27.616374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] RBAC: Authorizing `identity:get_user(user_id=dcaee547a4084147ad0c79f8261556a3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:27.617943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:27.619702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 567/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:27 2022] GET /identity/v3/users/dcaee547a4084147ad0c79f8261556a3 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:27.625658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:27.729517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f25b3-05b5-4fb7-af2d-780b161007f2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:27.763353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:27.764028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:27.764319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:27.764603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:27.819536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:27.832816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:27.834325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:27.929587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 577/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:27.936033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:28.034905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a13a-6935-4d54-8b30-3776295ae731 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:28.068283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a7ce0-1853-44c2-96fc-2b7d6a1b14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:28.069139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7ce0-1853-44c2-96fc-2b7d6a1b14ec None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:28.069468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7ce0-1853-44c2-96fc-2b7d6a1b14ec None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:28.069799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7ce0-1853-44c2-96fc-2b7d6a1b14ec None admin] PATH_INFO: `/v3/projects/0efd1291b8bc477fb2349c14f9fe733e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:28.070931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a7ce0-1853-44c2-96fc-2b7d6a1b14ec None admin] RBAC: Authorizing `identity:get_project(project_id=0efd1291b8bc477fb2349c14f9fe733e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:28.073138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a7ce0-1853-44c2-96fc-2b7d6a1b14ec None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:28.074919 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 568/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:27 2022] GET /identity/v3/projects/0efd1291b8bc477fb2349c14f9fe733e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:28.081220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:28.167596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:28.182564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb931a2-d9fd-4139-8ec3-36aecfa75c13 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:28.218463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:28.219109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:28.219397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:28.219678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:28.220509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=0efd1291b8bc477fb2349c14f9fe733e, user.id=dcaee547a4084147ad0c79f8261556a3) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:28.220825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:28.222284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd227b2-2bc4-4562-832c-abca63f425d1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:28.227660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 578/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:28 2022] GET /identity/v3/role_assignments?user.id=dcaee547a4084147ad0c79f8261556a3&scope.project.id=0efd1291b8bc477fb2349c14f9fe733e&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:30.297066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6bf2-ae14-4980-a8f3-4a3955c8b0b6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:30.297576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6bf2-ae14-4980-a8f3-4a3955c8b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:30.297689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6bf2-ae14-4980-a8f3-4a3955c8b0b6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:30.299027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 569/1147] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:30.304168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:30.304582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:30.304736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:30.321148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:30.322578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:30.387847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 579/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:30.411172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6bf2-ae14-4980-a8f3-4a3955c8b0b6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:30.454069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:30.513024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6bf2-ae14-4980-a8f3-4a3955c8b0b6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:30.546720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:30.547439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:30.547726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:30.548006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:30.557858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:30.565378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:30.566302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:30.567177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 570/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:30.573390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:30.652227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:30.670202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fe801-2781-4c2f-a44e-3360ee52e30c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:30.704250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:30.704918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:30.705207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:30.705522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:30.706299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:30.706615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:30.707997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:30.717118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 580/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:30.723039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:30.818657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:30.821500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e647c8f-eeaf-4e20-964f-0c5bd10ddeff None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:30.856716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:30.857616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:30.857893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:30.858168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] PATH_INFO: `/v3/users/dcaee547a4084147ad0c79f8261556a3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:30.859338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] RBAC: Authorizing `identity:get_user(user_id=dcaee547a4084147ad0c79f8261556a3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:30.860771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:30.862459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 571/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:30 2022] GET /identity/v3/users/dcaee547a4084147ad0c79f8261556a3 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:30.869541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:30.973467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3117cd-ecf3-4a1c-9694-42dacfbd611e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:31.006425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629de5a-a05c-4a6e-aecc-5eae3597ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:31.007277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629de5a-a05c-4a6e-aecc-5eae3597ca04 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:31.007600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629de5a-a05c-4a6e-aecc-5eae3597ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:31.007875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629de5a-a05c-4a6e-aecc-5eae3597ca04 None admin] PATH_INFO: `/v3/projects/0efd1291b8bc477fb2349c14f9fe733e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:31.010209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629de5a-a05c-4a6e-aecc-5eae3597ca04 None admin] RBAC: Authorizing `identity:get_project(project_id=0efd1291b8bc477fb2349c14f9fe733e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:31.011672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629de5a-a05c-4a6e-aecc-5eae3597ca04 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:31.013422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 581/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:30 2022] GET /identity/v3/projects/0efd1291b8bc477fb2349c14f9fe733e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:31.019356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:31.119886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc43e-e517-481f-b908-cf6989f90d60 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:31.153269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc65f7-72dd-4f8c-b3b3-d14eb9ad23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:31.154175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc65f7-72dd-4f8c-b3b3-d14eb9ad23cd None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:31.154465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc65f7-72dd-4f8c-b3b3-d14eb9ad23cd None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:31.154771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc65f7-72dd-4f8c-b3b3-d14eb9ad23cd None admin] PATH_INFO: `/v3/projects/0efd1291b8bc477fb2349c14f9fe733e/users/dcaee547a4084147ad0c79f8261556a3/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:31.156700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc65f7-72dd-4f8c-b3b3-d14eb9ad23cd None admin] RBAC: Authorizing `identity:create_grant(project_id=0efd1291b8bc477fb2349c14f9fe733e, user_id=dcaee547a4084147ad0c79f8261556a3, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:31.158164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc65f7-72dd-4f8c-b3b3-d14eb9ad23cd None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:31.242437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 572/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:30:31 2022] PUT /identity/v3/projects/0efd1291b8bc477fb2349c14f9fe733e/users/dcaee547a4084147ad0c79f8261556a3/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:30:33.298454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c45d-4dcf-4508-b868-272963eeb836 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:33.298985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c45d-4dcf-4508-b868-272963eeb836 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:33.299088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c45d-4dcf-4508-b868-272963eeb836 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:33.300407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 582/1154] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:33.305527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:33.306072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:33.306159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:33.322712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:33.323902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:33.346819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:33.390290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 573/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:33.414601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0c45d-4dcf-4508-b868-272963eeb836 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:33.430102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:33.520488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0c45d-4dcf-4508-b868-272963eeb836 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:33.556863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:33.557686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:33.557976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:33.558256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:33.568565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:33.576897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:33.578276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:33.579483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 583/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:33.584324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:33.699717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa2a2f-4e42-49cd-bfd9-4bce1d1ba717 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:33.740281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:33.740963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:33.741250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:33.741562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:33.742320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:33.742632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:33.744186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:33.757239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 574/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:33.764568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:33.848092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:33.880945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5a56e-c969-425e-95cc-4f3577229632 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:33.918181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:33.919063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:33.919353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:33.919671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] PATH_INFO: `/v3/users/dcaee547a4084147ad0c79f8261556a3` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:33.920871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=dcaee547a4084147ad0c79f8261556a3)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:33.922344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:33.924026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 584/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:33 2022] GET /identity/v3/users/dcaee547a4084147ad0c79f8261556a3 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:33.929996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:33.955445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:34.040044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aff09-e2c1-44a8-8603-4b46f3253774 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:34.078481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:34.079160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:34.079523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:34.079738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:34.153712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:34.155109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:34.178801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:34.268580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 575/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:34.276077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:34.385753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e02e6-207a-4e77-9dc3-36d668d33eb5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:34.419982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11f664-df56-42e9-9aa4-5adb1117d48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:34.420774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11f664-df56-42e9-9aa4-5adb1117d48d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:34.421071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11f664-df56-42e9-9aa4-5adb1117d48d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:34.421381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11f664-df56-42e9-9aa4-5adb1117d48d None admin] PATH_INFO: `/v3/projects/0efd1291b8bc477fb2349c14f9fe733e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:34.422537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11f664-df56-42e9-9aa4-5adb1117d48d None admin] RBAC: Authorizing `identity:get_project(project_id=0efd1291b8bc477fb2349c14f9fe733e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:34.423959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11f664-df56-42e9-9aa4-5adb1117d48d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:34.425716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 585/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:34 2022] GET /identity/v3/projects/0efd1291b8bc477fb2349c14f9fe733e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:34.432745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:34.548040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca1c6a-6db9-4da8-9242-5be23a3c1959 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:34.569501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:34.583872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:34.598395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:34.598395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:34.598395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:34.598395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=0efd1291b8bc477fb2349c14f9fe733e, user.id=dcaee547a4084147ad0c79f8261556a3) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:34.598395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:34.598395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5372d00-e19d-4302-ad05-5e9b430a8537 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:34.598945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 576/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:34 2022] GET /identity/v3/role_assignments?user.id=dcaee547a4084147ad0c79f8261556a3&scope.project.id=0efd1291b8bc477fb2349c14f9fe733e&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:36.747462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c8357-2f48-4d65-9053-3f5d759d2711 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:36.747961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c8357-2f48-4d65-9053-3f5d759d2711 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:36.747961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c8357-2f48-4d65-9053-3f5d759d2711 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:36.749365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 586/1162] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:36.754738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:36.755189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:36.755294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:36.778107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:36.779407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:36.847894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 577/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:30:36.872275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c8357-2f48-4d65-9053-3f5d759d2711 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:36.882565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:36.981076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c8357-2f48-4d65-9053-3f5d759d2711 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:37.017380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:37.017591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:37.017764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:37.018235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:37.092768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:37.094272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:37.103319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:37.198475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 587/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:37.204630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:37.310218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490687c5-1a51-4fa3-a9f9-14172f04e000 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:37.324975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:37.344966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:37.345809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:37.346118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:37.346401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:37.354147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:37.355616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d9733af1-f35e-44a4-b771-a3bdd6961759 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:37.371261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:37.372446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:37.373490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 578/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:30:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:37.378944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:37.482211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab565573-204a-40f0-a32e-4dbdae2b18e2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:37.489920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:37.516954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:37.517660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:37.517949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:37.518276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:37.519105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:37.519281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:37.520686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f109742-d4e1-4ad3-9e1c-aa37819316b4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:37.528949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 588/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Jun 21 16:30:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:39.603051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd137a2-8474-4bad-b7a9-4a66c03c167f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:39.603769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd137a2-8474-4bad-b7a9-4a66c03c167f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:39.603769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd137a2-8474-4bad-b7a9-4a66c03c167f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:39.605043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 579/1167] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:39.610982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f887e2-5533-41ab-921d-0dcd80456f02 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:39.611480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f887e2-5533-41ab-921d-0dcd80456f02 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:39.611581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f887e2-5533-41ab-921d-0dcd80456f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:39.631452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-39f887e2-5533-41ab-921d-0dcd80456f02 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:39.632652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-39f887e2-5533-41ab-921d-0dcd80456f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:39.706376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 589/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:39.731228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd137a2-8474-4bad-b7a9-4a66c03c167f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:39.840432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd137a2-8474-4bad-b7a9-4a66c03c167f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:39.878907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b85555-dffb-4d15-a7a0-afac529c2f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:39.879557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85555-dffb-4d15-a7a0-afac529c2f5a None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:39.879843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85555-dffb-4d15-a7a0-afac529c2f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:39.880123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b85555-dffb-4d15-a7a0-afac529c2f5a None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:39.880878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b85555-dffb-4d15-a7a0-afac529c2f5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:39.882333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b85555-dffb-4d15-a7a0-afac529c2f5a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:40.023661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 580/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Tue Jun 21 16:30:39 2022] POST /identity/v3/domains => generated 267 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:30:42.267510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf994c6-b040-4eb2-9534-98d03b5b1449 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:42.267887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf994c6-b040-4eb2-9534-98d03b5b1449 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:42.268041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf994c6-b040-4eb2-9534-98d03b5b1449 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:42.269504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 590/1170] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:42.275375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:42.276528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:42.276528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:42.293383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:42.294723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:42.321481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:42.362488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 581/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:42.387042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf994c6-b040-4eb2-9534-98d03b5b1449 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:42.483612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:42.487475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf994c6-b040-4eb2-9534-98d03b5b1449 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:42.520168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293d116-8914-4ed3-9a7d-52ae6db75d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:42.520954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293d116-8914-4ed3-9a7d-52ae6db75d0b None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:42.521237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293d116-8914-4ed3-9a7d-52ae6db75d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:42.521546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293d116-8914-4ed3-9a7d-52ae6db75d0b None admin] PATH_INFO: `/v3/domains/770af16bb16b43338a9d872e6652c765` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:42.533117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293d116-8914-4ed3-9a7d-52ae6db75d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=770af16bb16b43338a9d872e6652c765)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:42.534593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293d116-8914-4ed3-9a7d-52ae6db75d0b None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:42.536273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 591/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Tue Jun 21 16:30:42 2022] GET /identity/v3/domains/770af16bb16b43338a9d872e6652c765 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:42.542377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:42.645794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6078b-e087-492a-9d9c-eebb606f3f58 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:42.679468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca52cf5-dd82-4fce-895b-3b045e997822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:42.680124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca52cf5-dd82-4fce-895b-3b045e997822 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:42.680413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca52cf5-dd82-4fce-895b-3b045e997822 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:42.680691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca52cf5-dd82-4fce-895b-3b045e997822 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:42.681427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca52cf5-dd82-4fce-895b-3b045e997822 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:42.682866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca52cf5-dd82-4fce-895b-3b045e997822 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:42.803505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 582/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:30:42 2022] POST /identity/v3/projects => generated 361 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:30:44.927732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec093b0-76e7-47f6-9853-a4136e02578f None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:44.928435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec093b0-76e7-47f6-9853-a4136e02578f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:44.928435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec093b0-76e7-47f6-9853-a4136e02578f None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:44.930444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 592/1174] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:44.935813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:44.936258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:44.936384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:44.953409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:44.954608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:44.965888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:45.023529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 583/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:45.049451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec093b0-76e7-47f6-9853-a4136e02578f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:45.153871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec093b0-76e7-47f6-9853-a4136e02578f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:45.187306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0a63-4aeb-4130-b75a-2345378750fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:45.188081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0a63-4aeb-4130-b75a-2345378750fb None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:45.188370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0a63-4aeb-4130-b75a-2345378750fb None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:45.188650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0a63-4aeb-4130-b75a-2345378750fb None admin] PATH_INFO: `/v3/domains/770af16bb16b43338a9d872e6652c765` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:45.189844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c0a63-4aeb-4130-b75a-2345378750fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=770af16bb16b43338a9d872e6652c765)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:45.191276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c0a63-4aeb-4130-b75a-2345378750fb None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:45.193006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 593/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Tue Jun 21 16:30:45 2022] GET /identity/v3/domains/770af16bb16b43338a9d872e6652c765 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:45.199123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:45.311300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9305982-9a27-4083-9ea0-dd45066c32d2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:45.346814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f7fd9-4606-4a9f-be0c-492dbd9c5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:45.347496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f7fd9-4606-4a9f-be0c-492dbd9c5dbb None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:45.347859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f7fd9-4606-4a9f-be0c-492dbd9c5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:45.348143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f7fd9-4606-4a9f-be0c-492dbd9c5dbb None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:45.348894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f7fd9-4606-4a9f-be0c-492dbd9c5dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:45.350415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f7fd9-4606-4a9f-be0c-492dbd9c5dbb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:45.467632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 584/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:30:45 2022] POST /identity/v3/users => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:30:47.574586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275b99-b6be-4fc4-8233-0913eb85cb6a None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:47.575124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275b99-b6be-4fc4-8233-0913eb85cb6a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:47.575124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275b99-b6be-4fc4-8233-0913eb85cb6a None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:47.576468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 594/1178] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:47.584769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:47.585220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:47.585374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:47.591337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:47.604091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:47.609635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:47.684725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 585/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:30:47.718197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275b99-b6be-4fc4-8233-0913eb85cb6a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:47.748600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:47.835186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275b99-b6be-4fc4-8233-0913eb85cb6a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:47.873941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:47.874739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:47.875025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:47.875302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:47.886898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:47.894546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:47.895744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:47.896717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 595/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:47.902667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:48.013615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d1f44-c2aa-4416-8119-ab6547ae7d6d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:48.044993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:48.049987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:48.050665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:48.050948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:48.051234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:48.051976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:48.052287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:48.053736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:48.062793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 586/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:48.072965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:48.183168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:48.202150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acef9e-21b4-4a11-bcc0-6fa16cc6c743 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:48.240382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:48.241246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:48.241566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:48.242518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] PATH_INFO: `/v3/users/c89b4db3b271455f981b5a40f1be1a90` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:48.256800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] RBAC: Authorizing `identity:get_user(user_id=c89b4db3b271455f981b5a40f1be1a90)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:48.259265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:48.261231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 596/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:48 2022] GET /identity/v3/users/c89b4db3b271455f981b5a40f1be1a90 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:48.267030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:48.374709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e074-82b4-4b25-9245-e671ef195633 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:48.417265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:48.417943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:48.418233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:48.418611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:48.483273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:48.490685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:48.492961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:48.590277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 587/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:48.596273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:48.698712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62667b-00d5-4a50-9289-2ded8dcbf817 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:48.732494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3c67-4bd2-44f6-bac2-16ac429008b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:48.733462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3c67-4bd2-44f6-bac2-16ac429008b5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:48.733712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3c67-4bd2-44f6-bac2-16ac429008b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:48.733994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3c67-4bd2-44f6-bac2-16ac429008b5 None admin] PATH_INFO: `/v3/projects/a8deff23266b4d38acd5fd2f1229663a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:48.735171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc3c67-4bd2-44f6-bac2-16ac429008b5 None admin] RBAC: Authorizing `identity:get_project(project_id=a8deff23266b4d38acd5fd2f1229663a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:48.736593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc3c67-4bd2-44f6-bac2-16ac429008b5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:48.738361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 597/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:48 2022] GET /identity/v3/projects/a8deff23266b4d38acd5fd2f1229663a => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:30:48.745184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:48.836432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:48.844367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fb57-62e3-4d36-a1cd-552757624cf2 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:48.878473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:48.879125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:48.879415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:48.879694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:48.880527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=a8deff23266b4d38acd5fd2f1229663a, user.id=c89b4db3b271455f981b5a40f1be1a90) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:48.880842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:48.882316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f5168-97a8-460a-b1d1-45484bf1f0fa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:48.888265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 588/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:48 2022] GET /identity/v3/role_assignments?user.id=c89b4db3b271455f981b5a40f1be1a90&scope.project.id=a8deff23266b4d38acd5fd2f1229663a&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:50.916374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf41b9-a23d-4222-93ec-cae8c8907280 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:50.916912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf41b9-a23d-4222-93ec-cae8c8907280 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:50.916912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf41b9-a23d-4222-93ec-cae8c8907280 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:50.918521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 598/1186] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:50.924133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:50.924549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:50.924701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:50.941985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:50.943176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:51.009503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 589/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:30:51.033243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf41b9-a23d-4222-93ec-cae8c8907280 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:51.049342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:51.136383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf41b9-a23d-4222-93ec-cae8c8907280 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:51.169385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:51.170107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:51.170397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:51.170676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:51.181398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:51.188890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:51.190143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:51.191217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:30:51.193433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 599/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:51.197449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:51.289167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:51.301424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee0566-2e03-42b6-8180-df8110837b63 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:51.340565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:51.341235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:51.341584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:51.341870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:51.342624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:51.342940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:51.344352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:51.353692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 590/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:51.359718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:51.437321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:51.462046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a80a-ef29-423b-830f-eb51cdac317e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:51.505084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:51.506022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:51.506314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:51.506593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] PATH_INFO: `/v3/users/c89b4db3b271455f981b5a40f1be1a90` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:51.507856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] RBAC: Authorizing `identity:get_user(user_id=c89b4db3b271455f981b5a40f1be1a90)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:51.509331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:51.511012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 600/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:51 2022] GET /identity/v3/users/c89b4db3b271455f981b5a40f1be1a90 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:51.521829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:51.638744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d3f12-e4bd-47c1-b652-b30507662162 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:51.674233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e91d0-5474-44e5-8d5c-ddc4499d8864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:51.675092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e91d0-5474-44e5-8d5c-ddc4499d8864 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:51.675377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e91d0-5474-44e5-8d5c-ddc4499d8864 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:51.675660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e91d0-5474-44e5-8d5c-ddc4499d8864 None admin] PATH_INFO: `/v3/projects/a8deff23266b4d38acd5fd2f1229663a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:51.676849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e91d0-5474-44e5-8d5c-ddc4499d8864 None admin] RBAC: Authorizing `identity:get_project(project_id=a8deff23266b4d38acd5fd2f1229663a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:51.678334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e91d0-5474-44e5-8d5c-ddc4499d8864 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:51.680718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 591/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:51 2022] GET /identity/v3/projects/a8deff23266b4d38acd5fd2f1229663a => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:51.686787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:51.794776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c46a31-96e6-4045-874b-34d32a6a027c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:51.829866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b0614-ffe8-4d51-9cac-cfbc2975cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:51.830758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0614-ffe8-4d51-9cac-cfbc2975cc7f None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:51.831049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0614-ffe8-4d51-9cac-cfbc2975cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:51.831332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0614-ffe8-4d51-9cac-cfbc2975cc7f None admin] PATH_INFO: `/v3/projects/a8deff23266b4d38acd5fd2f1229663a/users/c89b4db3b271455f981b5a40f1be1a90/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:51.833369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b0614-ffe8-4d51-9cac-cfbc2975cc7f None admin] RBAC: Authorizing `identity:create_grant(project_id=a8deff23266b4d38acd5fd2f1229663a, user_id=c89b4db3b271455f981b5a40f1be1a90, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:51.834810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b0614-ffe8-4d51-9cac-cfbc2975cc7f None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:51.895366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 601/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:30:51 2022] PUT /identity/v3/projects/a8deff23266b4d38acd5fd2f1229663a/users/c89b4db3b271455f981b5a40f1be1a90/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:30:53.966242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcca0-3444-4fbd-9fee-c25df112fb2e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:53.966815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcca0-3444-4fbd-9fee-c25df112fb2e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:53.966815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcca0-3444-4fbd-9fee-c25df112fb2e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:53.968305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 592/1193] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:30:53.973690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:53.974143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:53.974263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:53.980319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:53.994137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:30:53.995325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:30:54.063854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 602/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:30:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:30:54.089175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcca0-3444-4fbd-9fee-c25df112fb2e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:54.109153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:54.192170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcca0-3444-4fbd-9fee-c25df112fb2e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:54.230083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:54.230781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:54.231061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:54.231332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:54.242685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:30:54.250195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:30:54.251321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:30:54.252192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 593/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:30:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:30:54.258358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:54.354849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57e962-fe16-4392-81fb-44cc0eda6383 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:54.385508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:54.390372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:54.391032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:54.391316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:54.391591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:54.392336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:54.392641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:54.394030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:54.402672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 603/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:30:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:54.408447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:54.485659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:54.506253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0dc02-0b0f-484a-a21b-3dca2c2e2b6d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:54.538996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:54.539826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:54.540108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:54.540382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] PATH_INFO: `/v3/users/c89b4db3b271455f981b5a40f1be1a90` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:54.541568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] RBAC: Authorizing `identity:get_user(user_id=c89b4db3b271455f981b5a40f1be1a90)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:54.543003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:54.544647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 594/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Jun 21 16:30:54 2022] GET /identity/v3/users/c89b4db3b271455f981b5a40f1be1a90 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:54.550467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:54.648954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa2e5-8ee3-4bf1-8c2e-1f97301f4850 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:54.682400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:54.683042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:54.683331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:54.683691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:54.742944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:54.750334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:54.751775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:54.852207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 604/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:30:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:30:54.858183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:54.958184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833c247-7387-4cb2-b7e7-6131c2623764 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:54.993066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8f28-0d6e-4ab7-a386-c97df31d1758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:54.993873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8f28-0d6e-4ab7-a386-c97df31d1758 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:54.994160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8f28-0d6e-4ab7-a386-c97df31d1758 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:54.994440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8f28-0d6e-4ab7-a386-c97df31d1758 None admin] PATH_INFO: `/v3/projects/a8deff23266b4d38acd5fd2f1229663a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:54.995651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8f28-0d6e-4ab7-a386-c97df31d1758 None admin] RBAC: Authorizing `identity:get_project(project_id=a8deff23266b4d38acd5fd2f1229663a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:54.997104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8f28-0d6e-4ab7-a386-c97df31d1758 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:54.998932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 595/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Jun 21 16:30:54 2022] GET /identity/v3/projects/a8deff23266b4d38acd5fd2f1229663a => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:30:55.005012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:30:55.094566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:30:55.102001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f24f7-79d1-441c-9b5f-723431ecb81e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:30:55.135367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:30:55.136015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:30:55.136305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:30:55.136589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:30:55.137461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=a8deff23266b4d38acd5fd2f1229663a, user.id=c89b4db3b271455f981b5a40f1be1a90) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:30:55.137778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:30:55.139200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc6797-62fd-48b4-955d-2c6a4c14a4bc None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:30:55.145064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 605/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:30:55 2022] GET /identity/v3/role_assignments?user.id=c89b4db3b271455f981b5a40f1be1a90&scope.project.id=a8deff23266b4d38acd5fd2f1229663a&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:31:04.989155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:31:05.142362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=21 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:13.307910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca209e76-8f09-4922-a3cf-e7e1b6311413 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:13.308521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca209e76-8f09-4922-a3cf-e7e1b6311413 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:13.308521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca209e76-8f09-4922-a3cf-e7e1b6311413 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:13.309911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 596/1201] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:13.315783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:13.316238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:13.316345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:13.333805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:13.335091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:13.402113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 606/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:13.428580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca209e76-8f09-4922-a3cf-e7e1b6311413 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:13.534483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca209e76-8f09-4922-a3cf-e7e1b6311413 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:13.567993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:13.568774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:13.569063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:13.569366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:13.579336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:13.580800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:13.598615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:13.599786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:13.601145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:13.601145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:13.601145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:13.601145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:13.601145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 597/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:13.606614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:13.704388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989717-b2ac-4eec-a5b0-54259198b92a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:13.733645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:13.739280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:13.739950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:13.740219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:13.740500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:13.741222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:13.741557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:13.742921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443ecb-bc9f-48d6-8da0-88f10299a0a1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:13.754732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 607/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:13.760941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:13.814660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:13.861033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f4f6b-9815-4f17-b9af-a290331f8945 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:13.894165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd379d-f066-4b4c-844d-b28020f4c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:13.894921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd379d-f066-4b4c-844d-b28020f4c452 None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:13.895212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd379d-f066-4b4c-844d-b28020f4c452 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:13.895494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd379d-f066-4b4c-844d-b28020f4c452 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:13.896207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd379d-f066-4b4c-844d-b28020f4c452 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:13.897695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd379d-f066-4b4c-844d-b28020f4c452 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:13.996850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 598/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Jun 21 16:32:13 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:32:16.070630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746cc5f-e25a-49fc-8dc2-b310de8f895e None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.071187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746cc5f-e25a-49fc-8dc2-b310de8f895e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.071290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746cc5f-e25a-49fc-8dc2-b310de8f895e None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.072623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 608/1206] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:16.078400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.078858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.078959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.096533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:16.099198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:16.166084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 599/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:16.190210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746cc5f-e25a-49fc-8dc2-b310de8f895e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:16.295139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746cc5f-e25a-49fc-8dc2-b310de8f895e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:16.328454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:16.329184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.329505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.329790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.341077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:32:16.348843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:16.349955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:16.356355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 609/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:32:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:16.357260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:16.396239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:16.455461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fe98e-8a72-435b-a02e-830a6db957d2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:16.494146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:16.495364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.495639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.495913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.496656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:16.496968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:16.498384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:16.511458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 600/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:16.517435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:16.567831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:16.617748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf0e80-b6d2-4aee-8790-5ea0d565c572 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:16.651698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:16.652482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.652770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.653051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.663362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:16.664798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:16.683213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:16.685412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:16.686323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:16.686323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:16.686323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:16.686323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:16.686323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 610/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:16.690175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:16.787549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:16.790422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424de59-7346-40ea-9b55-a3a241468b5d None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:16.823936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:16.824595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.824885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.825170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.826062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:16.826282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:16.827664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:16.839287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 601/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:16.845301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:16.944437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf544f-eb26-4cae-8538-d6a4cf77cae4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:16.945920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:16.980402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:16.981195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:16.981515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:16.981826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:16.988721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:16.990217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:32:17.005249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:17.006363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:17.007447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 611/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:17.012432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:17.112452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e27eda-fe3a-40fd-b920-18b65f0a5419 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:17.148206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:17.148870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:17.149154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:17.149459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:17.150284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:17.150592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:17.152550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:17.169927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 602/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Jun 21 16:32:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:17.175806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:17.275465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e6e3-1f4c-40a1-a2ae-60e27698bf83 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:17.310802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:17.311451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:17.311738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:17.312024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:17.342672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:17.379948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:17.381439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:17.477554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 612/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:32:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:32:17.484293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:17.503427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:17.581819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7215e2-1bcd-45b8-ab60-53906c7c2e96 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:17.614916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:17.619014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:17.619014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:17.619014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:17.626491 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:17.627945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:17.645452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:17.646464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:17.647695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:17.647695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:17.647695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:17.647695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:17.647695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 603/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:17.652953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:17.711230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:17.748530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3fa9-00c6-41d7-8b7a-e4f253fac246 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:17.783605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:17.785388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:17.785388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:17.785388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:17.785699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:17.786017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:17.787387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:17.799320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 613/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:17.805100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:17.875442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:17.905770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4899d-4f4f-4f14-a748-0bb61fbe7447 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:17.940048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:17.940835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:17.941157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:17.941468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:17.948480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:17.950084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:32:17.963492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:17.964618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:17.966510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 604/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:17.971490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:18.069296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3355-dedc-4783-b798-0a1c4d8eb6c4 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:18.092012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:18.103602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:18.104257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:18.104547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:18.104832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:18.105650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:18.105964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:18.107445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b62b-75ff-4f55-8ff0-6f5608253aa2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:18.118937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 614/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:18.128305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:18.225714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba99b6-0243-4191-8daa-01c23d235433 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:18.253684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:18.259556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:18.260212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:18.261118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:18.261502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:18.262353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=e5976deb8abc4c04b60380fa27703c4f) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:18.262671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:18.264138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10ac9-b09c-455d-b50c-deba2ed49b5a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:18.270133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 605/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:32:18 2022] GET /identity/v3/role_assignments?user.id=e5976deb8abc4c04b60380fa27703c4f&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:20.307813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f468a78-500e-4265-ac97-32fb53d12894 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:20.308368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f468a78-500e-4265-ac97-32fb53d12894 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:20.308565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f468a78-500e-4265-ac97-32fb53d12894 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:20.310049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 615/1220] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:20.315614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:20.316048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:20.316178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:20.333341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:20.334531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:20.400390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 606/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:32:20.424269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f468a78-500e-4265-ac97-32fb53d12894 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:20.528022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f468a78-500e-4265-ac97-32fb53d12894 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:20.563232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:20.564023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:20.564305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:20.564593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:20.575477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:32:20.583148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:20.584254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:20.585224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 616/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:32:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:20.591714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:20.691366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003a25-d678-4e6a-ade1-fbf9a53d43e1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:20.715877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:20.726113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613369-ae20-4613-a258-243858a4166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:20.726783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613369-ae20-4613-a258-243858a4166c None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:20.727073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613369-ae20-4613-a258-243858a4166c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:20.727356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613369-ae20-4613-a258-243858a4166c None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:20.728103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613369-ae20-4613-a258-243858a4166c None admin] RBAC: Adding query filter params (name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:20.728415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613369-ae20-4613-a258-243858a4166c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:20.729924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613369-ae20-4613-a258-243858a4166c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:20.737675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 607/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:32:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:32:20.743492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:20.789049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:20.843022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ab99-16be-4f6b-a6e7-0211aa7c4e50 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:20.876122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:20.876947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:20.877232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:20.877594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:20.888682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:20.890212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:20.907786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:20.908904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:20.910052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:20.910052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:20.910052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:20.910052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:20.910052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 617/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:20.914866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613369-ae20-4613-a258-243858a4166c None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.015354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613369-ae20-4613-a258-243858a4166c None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:21.048511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:21.049103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:21.049459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:21.049737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:21.050453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:21.050760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:21.052132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:21.064551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 608/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:21.070438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.163194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:21.170030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdad246-83fc-4a3f-8027-555e1f6ccb16 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:21.204087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:21.204888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:21.205176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:21.205485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:21.212532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:21.214057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:32:21.229166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:21.230560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:21.231721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 618/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:21.236557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.284288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:21.336883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef30b4-7032-4e94-afd8-fb188987cbdb None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:21.374192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:21.374865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:21.375156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:21.375526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:21.376416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:21.376729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:21.378206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:21.395669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 609/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Jun 21 16:32:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:21.401521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.500673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0abfa-4529-40d1-9631-1cc07a0dec12 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:21.533573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:21.534352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:21.534643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:21.534927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:21.545269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:21.546766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:21.565189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:21.566313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:21.567299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:21.567299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:21.567299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:21.567299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:21.567299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 619/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:21.572289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.673402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436250d-2bc5-44bb-b359-86c086c0b4fa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:21.676133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:21.707851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:21.708512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:21.708799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:21.709075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:21.709822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:21.710132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:21.711517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:21.723190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 610/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:21.729029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.739027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:21.829824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfc747-5bfe-4892-9f82-136396d5d0b1 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:21.865098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:21.865922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:21.866209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:21.866490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:21.873302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:21.874801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:32:21.888752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:21.890202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:21.891369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 620/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:21.895879 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:21.998460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cab982-89c4-4335-8e6e-38dc3490a2c3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:22.031694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:22.032353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:22.032642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:22.032928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:22.033756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:22.034059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:22.035492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d145-9369-4d83-a6bd-7fce020d8290 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:22.049222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 611/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:22.055164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:22.120857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:22.154286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd09e1-a58b-4c10-85ec-909963044585 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:22.188545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952d8c9-9f7b-476d-b3f5-371bb8499053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:22.189455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d8c9-9f7b-476d-b3f5-371bb8499053 None admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:22.189745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d8c9-9f7b-476d-b3f5-371bb8499053 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:22.190028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d8c9-9f7b-476d-b3f5-371bb8499053 None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/e5976deb8abc4c04b60380fa27703c4f/roles/4e78bc8d812b45ac86abc66cc15def12` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:22.204204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952d8c9-9f7b-476d-b3f5-371bb8499053 None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=e5976deb8abc4c04b60380fa27703c4f, role_id=4e78bc8d812b45ac86abc66cc15def12)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:22.205678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952d8c9-9f7b-476d-b3f5-371bb8499053 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:22.325917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 621/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:32:22 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/e5976deb8abc4c04b60380fa27703c4f/roles/4e78bc8d812b45ac86abc66cc15def12 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:32:24.386832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8276d-ae8a-4cd4-9616-d0df13b3e279 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:24.387427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8276d-ae8a-4cd4-9616-d0df13b3e279 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:24.387587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8276d-ae8a-4cd4-9616-d0df13b3e279 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:24.389409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 612/1233] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:24.394725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:24.398172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:24.398172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:24.412373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:24.413588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:24.479972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 622/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 16:32:24.503674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8276d-ae8a-4cd4-9616-d0df13b3e279 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:24.530832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:24.606116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8276d-ae8a-4cd4-9616-d0df13b3e279 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:24.638920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:24.639708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:24.639994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:24.640306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:24.650503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:32:24.660129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:24.661404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:24.662489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 613/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Jun 21 16:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:24.667737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:24.714563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:24.767766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c8b8-ff7a-443a-ac5d-8cbc94c6ce54 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:24.801451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:24.802049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:24.802366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:24.802650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:24.803399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:24.803732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:24.805107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:24.813740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 623/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Jun 21 16:32:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:24.819714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:24.906245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:24.922001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f919b3-4624-46d0-80c6-16015aa90eaa None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:24.958076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:24.958493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:24.958775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:24.959053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:24.970740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:24.972188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:24.988823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:24.989916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:24.991026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:24.991026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:24.991026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:24.991026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:24.991026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 614/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:24.996907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:25.096289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63079d-ff6b-4b03-9cdf-7cccae0c9c5c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:25.105353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:25.129375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:25.130025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:25.130312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:25.130594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:25.131312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:25.131626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:25.133074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:25.144699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 624/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:25.150482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:25.254429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8f206-ef12-4bc8-9e08-d4015b8dedbe None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:25.287720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:25.288554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:25.288945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:25.289230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:25.291916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:25.297716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:25.299166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:32:25.314445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:25.317108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:25.318300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 615/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:25.321491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:25.422927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85506-df06-49bd-93af-0fd579df65a3 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:25.457615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:25.458281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:25.458604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:25.458882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:25.459712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:25.460021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:25.461555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:25.480196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 625/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Jun 21 16:32:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:25.486224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:25.587581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f99d5d-b44c-409e-a3bd-ea8246ce5d74 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:25.622109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:25.622754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:25.623043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:25.623323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:25.683464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:25.689825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:25.691310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:25.787963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 616/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:32:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:32:25.794859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:25.821905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:25.894852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5c963-0190-4e39-a48d-5b9e63bbebf0 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:25.928589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:25.929344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:25.929632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:25.929909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:25.939932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:25.941289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:25.959072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:25.960179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:25.961297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:25.961297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:25.961297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:25.961297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:25.961297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 626/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:25.967211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:26.059853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:26.065645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276854-dce5-4d2c-8c4b-115df2e5b2ee None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:26.099940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:26.100605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:26.100894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:26.101174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:26.101926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:26.102237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:26.103619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:26.114757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 617/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:26.120433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:26.197622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:26.219273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc783eb9-1df6-4432-b558-3a001010b94c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:26.252135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:26.252921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:26.253211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:26.253522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:26.260715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:26.266930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:32:26.276807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:26.277962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:26.278991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 627/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:26.284026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:26.385583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a820bb9-1b0e-4b30-8b1e-9e18d2ff00c7 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:26.419765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:26.420430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:26.420721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:26.421007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:26.423617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:26.423617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:26.423803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c68f7-68a9-4eaf-abaf-0d0485efc1c6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:26.437341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 618/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:26.443362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:26.542910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b532e-39ca-4437-9d77-23bf293bd2e5 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:26.578512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:26.579167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:26.579452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:26.579729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:26.580558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] RBAC: Adding query filter params (role.id=4e78bc8d812b45ac86abc66cc15def12, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=e5976deb8abc4c04b60380fa27703c4f) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:26.580873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:26.582381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02c7c5-2a2f-41f1-8145-ad043ec0ea0e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:26.588386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 628/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:32:26 2022] GET /identity/v3/role_assignments?user.id=e5976deb8abc4c04b60380fa27703c4f&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=4e78bc8d812b45ac86abc66cc15def12 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:28.719337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38233b-88ab-4af1-9d7b-94fc0b7b7e52 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:28.719909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38233b-88ab-4af1-9d7b-94fc0b7b7e52 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:28.719909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38233b-88ab-4af1-9d7b-94fc0b7b7e52 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:28.721324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 619/1247] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:28.726448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:28.728448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:28.728448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:28.733208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:28.744890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:28.747151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:28.813408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 629/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:28.837842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38233b-88ab-4af1-9d7b-94fc0b7b7e52 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:28.857178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:28.940518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38233b-88ab-4af1-9d7b-94fc0b7b7e52 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:28.974458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:28.975171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:28.975483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:28.975759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:28.986567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:32:28.994276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:28.995418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:28.997731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 620/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:29.002432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:29.100070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072970aa-1ce7-4e6b-b193-54e884918803 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:29.129665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:29.134501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:29.135157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:29.135437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:29.135714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:29.136506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:29.137292 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:29.138780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:29.146608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 630/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:29.152394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:29.231674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:29.253708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7a41-7b13-4fc7-97f4-294e6d6172b0 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:29.288784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:29.289602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:29.289931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:29.290213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:29.301750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:29.304685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:29.320536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:29.321570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:29.322782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:29.322782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:29.322782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:29.322782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:29.322782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 621/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:29.328030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:29.427787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a875932-f75a-4cb0-b279-082313dbc381 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:29.460474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:29.461132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:29.461492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:29.461757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:29.462476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:29.462789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:29.464210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:29.476867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 631/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:29.483219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:29.585707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884acda-3b6f-4db5-b3a4-376a6a13d766 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:29.612325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:29.619920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:29.620717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:29.621037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:29.621655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:29.629959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:29.631431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:32:29.647037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:29.648205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:29.649171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 622/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:29.655248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:29.710254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:29.755251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea11f8a-ba6d-41bd-9df3-31309fadc122 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:29.787712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:29.793307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:29.793307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:29.793307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:29.793307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:29.793307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:29.793307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:29.809976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 632/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Jun 21 16:32:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:29.815671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:29.917971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651e187-8bb9-4525-82d0-65c14ff87c67 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:29.951428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:29.952077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:29.952387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:29.952649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:30.008141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:30.020973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:30.022498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:30.119256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 623/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:32:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:32:30.125761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:30.229939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9703-868c-430f-ab56-fa64ea6a8390 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:30.243658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:30.265376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:30.266143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:30.266443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:30.266726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:30.276771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:30.278475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:30.295581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:30.296763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:30.298637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:30.298637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:30.298637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:30.298637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:30.298637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 633/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:30.307496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:30.405161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:30.416652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e3897-8e05-47ec-9a5b-320f207de1dc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:30.452234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:30.452900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:30.453183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:30.453493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:30.454218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:30.454526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:30.455939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:30.468008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 624/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:30.473957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:30.582870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1275ad-2c7d-4cfc-94db-ed15510c1d6d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:30.623559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:30.624204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:30.625152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:30.625469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:30.633364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:30.634844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:32:30.653000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:30.654171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:30.655275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 634/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:30.661076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:30.767707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69da3a4-e3d1-48a5-bc22-9bd3b73fe1d1 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:30.801637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:30.802299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:30.802585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:30.802866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:30.803681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:30.803996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:30.805546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8a15b-1ac3-40b7-92be-5f0da29c7212 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:30.819967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 625/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:30.826302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:30.861929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:30.944938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72d77-dc48-4d17-a791-863e801a4f4a None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:30.986607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:30.987264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:30.987554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:30.987947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:30.988792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=e5976deb8abc4c04b60380fa27703c4f) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:30.989108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:30.990559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8248a-778a-4623-bd5f-bacd52341875 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:30.997413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 635/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:32:30 2022] GET /identity/v3/role_assignments?user.id=e5976deb8abc4c04b60380fa27703c4f&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:33.035908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e3f3-26cc-4681-8609-b3d9cfe103e2 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.036462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e3f3-26cc-4681-8609-b3d9cfe103e2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.036462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e3f3-26cc-4681-8609-b3d9cfe103e2 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.037900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 626/1261] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:33.043679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.044176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.044340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.062067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:33.063283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:33.129851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 636/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:33.152522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e3f3-26cc-4681-8609-b3d9cfe103e2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:33.163333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:33.254461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e3f3-26cc-4681-8609-b3d9cfe103e2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:33.288378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:33.288945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.289230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.289540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.300163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:32:33.307866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:33.309838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:33.310738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 627/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:33.316154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:33.334542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:33.415547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97f9f-d4f8-4fbd-b49d-4324a613e2ea None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:33.450035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:33.450749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.451032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.451317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.452067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:33.452379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:33.453790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:33.461901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 637/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:33.468926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:33.536974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:33.571082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef197bae-8fb3-455e-97b2-51e53b8459cc None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:33.605672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:33.606556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.606837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.607120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.617472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:33.618930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:33.636184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:33.637921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:33.638880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:33.638880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:33.638880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:33.638880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:33.638880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 628/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:33.644005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:33.725921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:33.744415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ef555-9d2d-4203-87ac-7b7419b4d8c8 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:33.778167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:33.778828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.779119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.779404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.780126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:33.780439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:33.781869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:33.793566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 638/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:33.799683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:33.901268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072250c8-9e62-4943-af08-0cde249ca399 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:33.922066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:33.936517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:33.937340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:33.937633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:33.937962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:33.945395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:33.946842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:32:33.960969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:33.971095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:33.972285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 629/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:32:33.973064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:34.070169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66394-c38b-46a0-8675-1e0a0fcfabdc None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:34.103361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:34.104025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:34.104316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:34.104598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:34.105492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:34.106394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:34.107928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:34.116795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:34.125218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 639/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Jun 21 16:32:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:34.130997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:34.235156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b72f-fa63-4ff4-8978-794653fe0d48 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:34.269601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:34.270474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:34.270853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:34.271142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:34.282365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:34.283833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:34.301777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:34.302992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:34.303967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:34.303967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:34.303967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:34.303967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:34.303967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 630/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:34.308803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:34.410287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43086-1bb3-4e4b-b898-3d6238eb191c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:34.444271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:34.444921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:34.445363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:34.445661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:34.446388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:34.446703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:34.448103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:34.460574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 640/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:34.467095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:34.499390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:34.568924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54759f5-ad52-4157-a332-f6609a9ee55f None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:34.604291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:34.605145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:34.605477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:34.605876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:34.612599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:34.614092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:32:34.629011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:34.635732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:34.637493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 631/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 16:32:34.638136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:34.698632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:34.740559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496eed5-9abc-4667-973c-f596a54473f2 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:34.773496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:34.774143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:34.774414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:34.774691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:34.775470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:34.775779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:34.777188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661b71-952a-449d-a4fb-a2f8f8b38e6d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:34.790149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 641/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:34.796778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:34.888844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:34.897226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067ba57-0345-4d4b-8c4d-276c53665ca6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:34.929958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8c0df-0a26-4c8e-8a6a-bec92ec80a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:34.930832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8c0df-0a26-4c8e-8a6a-bec92ec80a8c None admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:34.931114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8c0df-0a26-4c8e-8a6a-bec92ec80a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:34.931390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8c0df-0a26-4c8e-8a6a-bec92ec80a8c None admin] PATH_INFO: `/v3/projects/3416d28217fe44a494d525a56e6508f6/users/e5976deb8abc4c04b60380fa27703c4f/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:34.933329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8c0df-0a26-4c8e-8a6a-bec92ec80a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=3416d28217fe44a494d525a56e6508f6, user_id=e5976deb8abc4c04b60380fa27703c4f, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:34.936022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8c0df-0a26-4c8e-8a6a-bec92ec80a8c None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:35.002512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 632/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Jun 21 16:32:34 2022] PUT /identity/v3/projects/3416d28217fe44a494d525a56e6508f6/users/e5976deb8abc4c04b60380fa27703c4f/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:32:37.034916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15cec-53e4-41cb-8403-037634f1752f None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.035519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15cec-53e4-41cb-8403-037634f1752f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.035519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15cec-53e4-41cb-8403-037634f1752f None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.036896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 642/1274] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:37.042130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.042589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.042700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.058882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:37.060131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:37.128379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 633/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:37.154729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d15cec-53e4-41cb-8403-037634f1752f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:37.256152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d15cec-53e4-41cb-8403-037634f1752f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:37.274253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:37.291400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:37.292126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.292417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.292695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.302748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 16:32:37.311259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:37.320572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:37.321726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 643/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Jun 21 16:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:37.322541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:37.401397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:37.419194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5bafc-5a06-4316-ab73-d39b5189c8ba None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:37.452497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:37.453301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.460807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.460807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.460807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:37.460807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:37.460807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:37.464776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 634/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Jun 21 16:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:37.470860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:37.572682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cd0ab-cb1f-47ea-9132-d4f8c746b567 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:37.606484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:37.607359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.607688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.607937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.618825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:37.620334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:37.638462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:37.639624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:37.640592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:37.640592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:37.640592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:37.640592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:37.640592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 644/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:37.645509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:37.749704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5b33-9da5-44e2-b4d6-f41d97f97558 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:37.782268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:37.782931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.783220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.783503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.784220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:37.784531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:37.785943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:37.798289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 635/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:37.804131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:37.834881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:37.903172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85117539-581c-4cf3-8132-f0f3e800e069 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:37.937625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:37.939625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:37.939625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:37.939625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:37.946026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:37.947460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 16:32:37.962142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:37.963312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:37.964547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 645/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:37.970941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:37.974917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:38.068324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743be37-c3d0-4660-b747-98bbd94df08a None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:38.100997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:38.101620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:38.101905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:38.102182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:38.103007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:38.103316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:38.104746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:38.121976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 636/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Jun 21 16:32:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:38.127961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:38.222534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:38.232179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f221db2-2f04-4ff1-9c7b-9a7f6ecd3a01 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:38.267849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:38.268177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:38.268465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:38.268750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:38.336724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:38.338199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:38.426233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:38.436169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 646/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Jun 21 16:32:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 16:32:38.442285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:38.504576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:38.542822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ddad-92fe-4f1a-8fe8-ab68ced4dab6 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:38.576360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:38.577150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:38.577468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:38.577749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:38.587353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:38.588805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 16:32:38.606932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:38.611140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:38.612075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 16:32:38.612075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 16:32:38.612075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 16:32:38.612075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:38.612075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 637/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:38.614133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:38.715164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310291-ce19-4269-bf89-bb79d45d5fa6 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:38.750107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:38.750764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:38.751053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:38.751336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:38.752059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:38.752373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:38.753789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:38.766278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 647/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Jun 21 16:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:38.771957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:38.877734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763dac2-f874-4fd4-851c-08c70ce71b62 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:38.892532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:38.911946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:38.912732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:38.913024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:38.913334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:38.919943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:38.921445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 16:32:38.937186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:38.946743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: ERROR keystone.server.flask.application Jun 21 16:32:38.947712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 638/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Jun 21 16:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:38.948232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:38.994713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:39.045079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3017e2-3dda-4db6-bc3f-78e5bdea0d7d None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:39.078299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:39.078946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:39.079230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:39.079506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:39.080284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:39.080594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:39.082100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630115e-128a-40fe-802a-b1cfa3e1d949 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:39.094638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 648/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Jun 21 16:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:39.100896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:39.199534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87ce85-eec2-4f20-9bae-da903f7a03f3 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:39.233706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:39.234350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:39.234638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:39.234921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:39.235750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] RBAC: Adding query filter params (role.id=226a8ee9fffe4695abdd8ff7ca4f1eba, scope.project.id=3416d28217fe44a494d525a56e6508f6, user.id=e5976deb8abc4c04b60380fa27703c4f) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:39.236064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:39.237521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa566ab5-38e7-43f0-b857-42bcab9b266b None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:39.243369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 639/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Jun 21 16:32:39 2022] GET /identity/v3/role_assignments?user.id=e5976deb8abc4c04b60380fa27703c4f&scope.project.id=3416d28217fe44a494d525a56e6508f6&role.id=226a8ee9fffe4695abdd8ff7ca4f1eba => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:41.295216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d49ef-e029-47dc-983e-35cedcc7f9c7 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:41.295722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d49ef-e029-47dc-983e-35cedcc7f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:41.295821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d49ef-e029-47dc-983e-35cedcc7f9c7 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:41.297179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 649/1288] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:32:41.302277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:41.302655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:41.302834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:41.319286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:41.320454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:41.351651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:41.390829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 640/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:41.415038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d49ef-e029-47dc-983e-35cedcc7f9c7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:41.523379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d49ef-e029-47dc-983e-35cedcc7f9c7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:41.535015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:41.557953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:41.558744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:41.559059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:41.559407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:41.560078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:41.561476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:41.573231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:41.574572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:41.576467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 650/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:32:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:41.581138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:41.680829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b590421-b0eb-49b6-83a4-47208da000af None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:41.715178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:41.716086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:41.716299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:41.716583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:41.717603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:41.717917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:41.719343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5be2e-4bd4-4a44-9385-b2501ab3bf39 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:41.724400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 641/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Jun 21 16:32:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:41.731297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:41.853733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6956f-96e0-4c13-bc0f-5d56845db15e None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:41.897826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:41.898512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:41.898806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:41.899092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] PATH_INFO: `/v3/services` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:41.899818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:41.900138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:41.901563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af2b1d-0969-4b87-9f87-092b237725fd None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:41.916776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 651/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Jun 21 16:32:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:43.916597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be472-79ec-45ac-be39-8c4081deef28 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:43.917135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be472-79ec-45ac-be39-8c4081deef28 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:43.917135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be472-79ec-45ac-be39-8c4081deef28 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:43.918608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 642/1293] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:43.923929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812bb28-ee25-4640-990c-00bd0bbbedce None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:43.930704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812bb28-ee25-4640-990c-00bd0bbbedce None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:43.930704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812bb28-ee25-4640-990c-00bd0bbbedce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:43.941433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8812bb28-ee25-4640-990c-00bd0bbbedce None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:43.942678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8812bb28-ee25-4640-990c-00bd0bbbedce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:43.972470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:44.010186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 652/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:44.034052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5be472-79ec-45ac-be39-8c4081deef28 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:44.064433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:44.131498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5be472-79ec-45ac-be39-8c4081deef28 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:44.164461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e440-7456-4f57-8000-f1c602cc211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:44.165380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e440-7456-4f57-8000-f1c602cc211f None admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:44.165501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e440-7456-4f57-8000-f1c602cc211f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:44.165726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e440-7456-4f57-8000-f1c602cc211f None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:44.166436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e440-7456-4f57-8000-f1c602cc211f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:44.167845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e440-7456-4f57-8000-f1c602cc211f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:44.259038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 643/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Jun 21 16:32:44 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:32:46.333090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c59d-c8f4-4af1-ac84-742ae3746757 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:46.333789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c59d-c8f4-4af1-ac84-742ae3746757 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:46.333789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c59d-c8f4-4af1-ac84-742ae3746757 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:46.335093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 653/1296] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:46.340191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:46.340577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:46.340845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:46.358139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:46.365150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:46.432418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 644/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:46.456967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c59d-c8f4-4af1-ac84-742ae3746757 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:46.564447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c59d-c8f4-4af1-ac84-742ae3746757 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:46.598887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:46.599676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:46.599960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:46.600282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:46.600937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:46.602340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:46.614893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:46.615969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:46.616817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 654/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:32:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:46.623390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:46.642537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:46.727833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6e04f-96e1-4f65-b68a-695021e8e499 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:46.766401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:46.767077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:46.767368 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:46.767646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:46.768369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:46.768678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:46.770102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:46.775889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 645/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Jun 21 16:32:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:46.783092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:46.823242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:46.908011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdc611-6846-44c0-b3e1-5530042e8f99 None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:46.946721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:46.946721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:46.999625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:46.999625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:46.999625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] RBAC: Adding query filter params (interface=public, service_id=534ebefbc86a4b4c8cb709f429150aca, region_id=RegionOne) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:46.999625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:46.999625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6f437-a6c7-4fc5-bb96-dc1b79505f8d None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:46.999625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 655/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Jun 21 16:32:46 2022] GET /identity/v3/endpoints?service_id=534ebefbc86a4b4c8cb709f429150aca&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:32:47.000125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:47.048157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:47.066612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564c2ec-8480-4e71-b349-5ca9b3805c64 None admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:47.103709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a4aad-06e3-4596-8abe-9c446df6e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:47.104337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4aad-06e3-4596-8abe-9c446df6e00f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:47.104632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4aad-06e3-4596-8abe-9c446df6e00f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:47.104915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4aad-06e3-4596-8abe-9c446df6e00f None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:47.105639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a4aad-06e3-4596-8abe-9c446df6e00f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:47.107854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a4aad-06e3-4596-8abe-9c446df6e00f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:47.116216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 646/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Jun 21 16:32:46 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:32:49.339870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf646ad8-7759-4543-863f-0d1655540349 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:49.340425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf646ad8-7759-4543-863f-0d1655540349 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:49.340425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf646ad8-7759-4543-863f-0d1655540349 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:49.341942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 656/1302] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:32:49.347527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:49.347953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:49.348138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:49.364178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:32:49.365393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:32:49.433033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 647/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:32:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 16:32:49.458211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf646ad8-7759-4543-863f-0d1655540349 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:49.553119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:49.560676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf646ad8-7759-4543-863f-0d1655540349 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:49.597208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:49.598034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:49.598319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:49.598595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:49.599239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:49.600591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 16:32:49.613098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 16:32:49.614349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application with Lock( Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self._enter() Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application return self.creator() Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application created_value = creator( Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: ERROR keystone.server.flask.application Jun 21 16:32:49.615418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 657/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Jun 21 16:32:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 16:32:49.620418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:49.706774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:32:49.730998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98b13-bdfd-4cd9-8958-01ead4c3a0df None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:49.764994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:49.770395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:49.770395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:49.770395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] PATH_INFO: `/v3/services` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:49.770395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:32:49.770395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:49.770395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45776397-180b-415b-9994-4f59e87d1c5f None admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:49.773949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 648/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Jun 21 16:32:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:32:49.780130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:32:49.881625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d172f-2261-48fa-8236-1e8bb988585c None admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:32:49.914524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e435-5ab9-4119-97f8-0d85b3bc0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:32:49.915178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e435-5ab9-4119-97f8-0d85b3bc0da5 None admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:32:49.915468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e435-5ab9-4119-97f8-0d85b3bc0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:32:49.915752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e435-5ab9-4119-97f8-0d85b3bc0da5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:32:49.916500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698e435-5ab9-4119-97f8-0d85b3bc0da5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:32:49.917890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698e435-5ab9-4119-97f8-0d85b3bc0da5 None admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:32:50.024778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 658/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Jun 21 16:32:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:32:59.875377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=30 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:33:00.019995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:06.696217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5339-8056-40ac-adaf-39a71bcec300 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:06.696753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5339-8056-40ac-adaf-39a71bcec300 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:06.696753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5339-8056-40ac-adaf-39a71bcec300 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:06.698430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 649/1307] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:06.703955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce0d0-1a40-4366-9e25-4a9ffc47a151 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:06.704431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce0d0-1a40-4366-9e25-4a9ffc47a151 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:06.704514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce0d0-1a40-4366-9e25-4a9ffc47a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:06.794040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-97dce0d0-1a40-4366-9e25-4a9ffc47a151 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:06.795283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-97dce0d0-1a40-4366-9e25-4a9ffc47a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:06.916948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 659/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:06.979323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdab7-2236-4e21-ae11-75d9d75f7322 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:06.979620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdab7-2236-4e21-ae11-75d9d75f7322 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:06.979903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdab7-2236-4e21-ae11-75d9d75f7322 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:06.981707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 650/1309] 10.222.0.70 () {54 vars in 964 bytes} [Tue Jun 21 16:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:06.987516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840db92c-aff5-46a9-91a7-6a4056c6c031 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:06.987813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840db92c-aff5-46a9-91a7-6a4056c6c031 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:06.988094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840db92c-aff5-46a9-91a7-6a4056c6c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:07.071208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-840db92c-aff5-46a9-91a7-6a4056c6c031 None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:07.072450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-840db92c-aff5-46a9-91a7-6a4056c6c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:07.096518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:07.171284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 660/1310] 10.222.0.70 () {58 vars in 1061 bytes} [Tue Jun 21 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:40:07.182124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cdab7-2236-4e21-ae11-75d9d75f7322 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:07.182888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e17cdab7-2236-4e21-ae11-75d9d75f7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:07.325668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cdab7-2236-4e21-ae11-75d9d75f7322 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:07.419205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:07.419904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:07.420192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:07.420519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:07.422252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:07.480470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:07.535082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:07.536590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d472c5-8eb0-4b89-8720-c9fcc75cf3ee service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:07.555498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 651/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:09.907011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7a93-8f0c-4ccb-b2da-9434062e1587 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:09.907547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7a93-8f0c-4ccb-b2da-9434062e1587 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:09.907547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7a93-8f0c-4ccb-b2da-9434062e1587 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:09.909119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 661/1312] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:09.914456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c36c-215a-4cef-980f-98db9e04a973 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:09.914900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c36c-215a-4cef-980f-98db9e04a973 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:09.915095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c36c-215a-4cef-980f-98db9e04a973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:09.989693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-90f1c36c-215a-4cef-980f-98db9e04a973 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:09.990930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-90f1c36c-215a-4cef-980f-98db9e04a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:10.097100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 652/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:10.137498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7a93-8f0c-4ccb-b2da-9434062e1587 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:10.139222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a4ac7a93-8f0c-4ccb-b2da-9434062e1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:10.260908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7a93-8f0c-4ccb-b2da-9434062e1587 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:10.344851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:10.347797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:10.349047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:10.349637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:10.349858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:10.351659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:10.481458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:10.483040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548a697-9014-46a1-9128-47deaf0a40ea service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:10.507412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 662/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:13.103468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c1f2d-dee1-44f3-86f7-7ac0ec7c5706 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:13.104030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c1f2d-dee1-44f3-86f7-7ac0ec7c5706 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:13.104030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c1f2d-dee1-44f3-86f7-7ac0ec7c5706 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:13.105528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 653/1315] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:13.110851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8445a-e141-4ba6-a91b-3be6b55f172b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:13.111236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8445a-e141-4ba6-a91b-3be6b55f172b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:13.111409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8445a-e141-4ba6-a91b-3be6b55f172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:13.176403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-a9b8445a-e141-4ba6-a91b-3be6b55f172b None None] MFA Rules not processed for user `df0ccfdb6af840879aee5a3f4397093a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:13.177879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a9b8445a-e141-4ba6-a91b-3be6b55f172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:13.230023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:13.276251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 663/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:13.318097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c1f2d-dee1-44f3-86f7-7ac0ec7c5706 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:13.319631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fe2c1f2d-dee1-44f3-86f7-7ac0ec7c5706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:13.330397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:13.423360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c1f2d-dee1-44f3-86f7-7ac0ec7c5706 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:13.494981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:13.495631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:13.495918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:13.496196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:13.497911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:13.560833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:13.607701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:13.609148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f7f7f-bd1b-4098-bd37-1360b63ff67c service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:13.627382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 654/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:16.595798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3c01-1266-4e7b-8dab-a9656ac11ff7 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:16.596358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3c01-1266-4e7b-8dab-a9656ac11ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:16.596358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3c01-1266-4e7b-8dab-a9656ac11ff7 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:16.597762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 664/1318] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:16.603258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d100d7-77f7-4e05-8261-9ee5a32b66c6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:16.603734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d100d7-77f7-4e05-8261-9ee5a32b66c6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:16.603836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d100d7-77f7-4e05-8261-9ee5a32b66c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:16.668995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-02d100d7-77f7-4e05-8261-9ee5a32b66c6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:16.670303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-02d100d7-77f7-4e05-8261-9ee5a32b66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:16.770869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 655/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:16.825573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a6fb4-c81b-4e9c-8505-2889c922d074 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:16.825863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a6fb4-c81b-4e9c-8505-2889c922d074 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:16.826150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a6fb4-c81b-4e9c-8505-2889c922d074 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:16.827628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 665/1320] 10.222.0.70 () {54 vars in 964 bytes} [Tue Jun 21 16:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:16.833866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860bccf-f70f-4d2a-833b-02344b5dbb72 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:16.834191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860bccf-f70f-4d2a-833b-02344b5dbb72 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:16.834474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860bccf-f70f-4d2a-833b-02344b5dbb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:16.856344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:16.911005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5860bccf-f70f-4d2a-833b-02344b5dbb72 None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:16.912228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5860bccf-f70f-4d2a-833b-02344b5dbb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:16.987142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 656/1321] 10.222.0.70 () {58 vars in 1061 bytes} [Tue Jun 21 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:16.996315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a6fb4-c81b-4e9c-8505-2889c922d074 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:16.997868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d96a6fb4-c81b-4e9c-8505-2889c922d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:17.101460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a6fb4-c81b-4e9c-8505-2889c922d074 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:17.173360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:17.173915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:17.174199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:17.174475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:17.176246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:17.183028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:17.287293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:17.288985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4b39-020f-42a7-ae4e-07fd4062ba3d service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:17.308950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 666/1322] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:21.029984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1602d-392b-4c01-af62-43a1a4d49fd1 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:21.030557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1602d-392b-4c01-af62-43a1a4d49fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:21.030557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1602d-392b-4c01-af62-43a1a4d49fd1 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:21.031965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 657/1323] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:21.037902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421d58-b204-429a-8319-18b21f0b1060 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:21.038353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421d58-b204-429a-8319-18b21f0b1060 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:21.038459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421d58-b204-429a-8319-18b21f0b1060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:21.105881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e9421d58-b204-429a-8319-18b21f0b1060 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:21.107098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e9421d58-b204-429a-8319-18b21f0b1060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:21.168772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:21.211185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 667/1324] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:21.248913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1602d-392b-4c01-af62-43a1a4d49fd1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:21.250511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-32a1602d-392b-4c01-af62-43a1a4d49fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:21.371091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1602d-392b-4c01-af62-43a1a4d49fd1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:21.386950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:21.462872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:21.463539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:21.463826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:21.464105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:21.465831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:21.604988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:21.606467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1b7c9-85a7-4dca-9e78-db8d6834c593 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:21.627356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 658/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:23.793300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41864b1-2a05-49a6-96f9-aaa4e2ba82d9 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:23.793862 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41864b1-2a05-49a6-96f9-aaa4e2ba82d9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:23.793862 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41864b1-2a05-49a6-96f9-aaa4e2ba82d9 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:23.795431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 668/1326] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:23.801816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008fff-de60-41b7-aa6a-c0dd03d3ff0c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:23.802336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008fff-de60-41b7-aa6a-c0dd03d3ff0c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:23.802452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008fff-de60-41b7-aa6a-c0dd03d3ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:23.858432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:23.882920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-73008fff-de60-41b7-aa6a-c0dd03d3ff0c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:23.893990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-73008fff-de60-41b7-aa6a-c0dd03d3ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:23.992914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 659/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:24.030364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41864b1-2a05-49a6-96f9-aaa4e2ba82d9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:24.032056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f41864b1-2a05-49a6-96f9-aaa4e2ba82d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:24.147344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41864b1-2a05-49a6-96f9-aaa4e2ba82d9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:24.232746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:24.233419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:24.233704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:24.233984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:24.235660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:24.255891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:24.369613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:24.371590 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002a922-9ef7-4c66-b568-be0bbe025e53 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:24.392902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 669/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:26.529876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd336-5820-4354-aaf8-6b130ddc4d7f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:26.530394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd336-5820-4354-aaf8-6b130ddc4d7f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:26.530394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd336-5820-4354-aaf8-6b130ddc4d7f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:26.531814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 660/1329] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:26.538335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5a50-d84d-4320-a23c-31e185c313be None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:26.538914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5a50-d84d-4320-a23c-31e185c313be None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:26.539031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be5a50-d84d-4320-a23c-31e185c313be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:26.608064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f2be5a50-d84d-4320-a23c-31e185c313be None None] MFA Rules not processed for user `df0ccfdb6af840879aee5a3f4397093a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:26.609304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f2be5a50-d84d-4320-a23c-31e185c313be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:26.678000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:26.710948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 670/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:26.749564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd336-5820-4354-aaf8-6b130ddc4d7f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:26.751144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-401fd336-5820-4354-aaf8-6b130ddc4d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:26.861632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd336-5820-4354-aaf8-6b130ddc4d7f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:26.882594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:26.937605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:26.938259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:26.938547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:26.938828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:26.940466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:27.052676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:27.054219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e6bd-6806-4569-86c8-6b5145201715 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:27.073805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 661/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:29.632569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bddd5-c1f7-4984-b0b9-7d912b92ca37 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:29.633098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bddd5-c1f7-4984-b0b9-7d912b92ca37 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:29.633098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bddd5-c1f7-4984-b0b9-7d912b92ca37 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:29.634475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 671/1332] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:29.639689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651b63-763f-4ef3-a3cf-dad83961ff57 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:29.640127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651b63-763f-4ef3-a3cf-dad83961ff57 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:29.640253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21651b63-763f-4ef3-a3cf-dad83961ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:29.705996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:29.708918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-21651b63-763f-4ef3-a3cf-dad83961ff57 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:29.710199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-21651b63-763f-4ef3-a3cf-dad83961ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:29.807479 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 662/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:29.842872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bddd5-c1f7-4984-b0b9-7d912b92ca37 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:29.844440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f06bddd5-c1f7-4984-b0b9-7d912b92ca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:29.949804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bddd5-c1f7-4984-b0b9-7d912b92ca37 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:30.022188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:30.029754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:30.029754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:30.029754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:30.029754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:30.052605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:30.132701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:30.134195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735212-2ed7-408e-994a-eaf1311a1d68 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:30.152757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 672/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:32.279979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe2a8-9ea3-4233-a0c8-dc21d6e9b161 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:32.279979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe2a8-9ea3-4233-a0c8-dc21d6e9b161 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:32.279979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe2a8-9ea3-4233-a0c8-dc21d6e9b161 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:32.279979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 663/1335] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:32.280676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550696f0-4a65-40b9-91f6-b8c24f0c6703 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:32.280676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550696f0-4a65-40b9-91f6-b8c24f0c6703 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:32.280676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550696f0-4a65-40b9-91f6-b8c24f0c6703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:32.344619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-550696f0-4a65-40b9-91f6-b8c24f0c6703 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:32.345868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-550696f0-4a65-40b9-91f6-b8c24f0c6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:32.419871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:32.442641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 673/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:32.482240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe2a8-9ea3-4233-a0c8-dc21d6e9b161 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:32.483773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5c7fe2a8-9ea3-4233-a0c8-dc21d6e9b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:32.587849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe2a8-9ea3-4233-a0c8-dc21d6e9b161 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:32.616132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:32.660617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:32.661238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:32.661560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:32.661841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:32.663486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:32.779314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:32.780762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bef3f2-df6c-45e8-a018-a1f3e0a81066 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:32.799916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 664/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:35.423645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f008b1a-7768-400a-b0b7-0b7637455f21 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:35.424196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f008b1a-7768-400a-b0b7-0b7637455f21 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:35.424196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f008b1a-7768-400a-b0b7-0b7637455f21 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:35.426236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 674/1338] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:35.431764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33211e-ba4b-41b4-b298-8ad1f5fd3c19 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:35.432196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33211e-ba4b-41b4-b298-8ad1f5fd3c19 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:35.432329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33211e-ba4b-41b4-b298-8ad1f5fd3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:35.497121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ff33211e-ba4b-41b4-b298-8ad1f5fd3c19 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:35.498395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ff33211e-ba4b-41b4-b298-8ad1f5fd3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:35.507254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:35.595367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 665/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:35.632035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f008b1a-7768-400a-b0b7-0b7637455f21 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:35.633676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2f008b1a-7768-400a-b0b7-0b7637455f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:35.735928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f008b1a-7768-400a-b0b7-0b7637455f21 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:35.809426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:35.810082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:35.810373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:35.810659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:35.812341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:35.846461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:35.919741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:35.921339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a187d-8476-436d-976c-f58e88a21e9c service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:35.940485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 675/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:40.410944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a578127-73a0-46b4-98bb-7e63912f52da None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:40.411513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a578127-73a0-46b4-98bb-7e63912f52da None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:40.411513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a578127-73a0-46b4-98bb-7e63912f52da None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:40.413005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 666/1341] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:40:40.418427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03783-a23b-4c0b-8d8f-767875726b6e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:40.419105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03783-a23b-4c0b-8d8f-767875726b6e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:40.419105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03783-a23b-4c0b-8d8f-767875726b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:40.500740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f9d03783-a23b-4c0b-8d8f-767875726b6e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:40.501999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f9d03783-a23b-4c0b-8d8f-767875726b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:40.612708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:40.626227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 676/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:40.667208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a578127-73a0-46b4-98bb-7e63912f52da None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:40.670285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a578127-73a0-46b4-98bb-7e63912f52da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:40.790266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a578127-73a0-46b4-98bb-7e63912f52da None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:40.793992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48245862-4950-427e-a9a4-b80baa2bd727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:40.794636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48245862-4950-427e-a9a4-b80baa2bd727 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:40.794913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48245862-4950-427e-a9a4-b80baa2bd727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:40.795200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48245862-4950-427e-a9a4-b80baa2bd727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:40.806475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48245862-4950-427e-a9a4-b80baa2bd727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:40.807935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48245862-4950-427e-a9a4-b80baa2bd727 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:40.818332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 667/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:44.010535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0375d-c4d7-4929-9db5-a937036d85ee None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:44.011365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0375d-c4d7-4929-9db5-a937036d85ee None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:44.011365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0375d-c4d7-4929-9db5-a937036d85ee None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:44.012786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 677/1344] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:44.020665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259842d-772c-43b7-9ac1-3ecec7ded1b8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:44.021235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259842d-772c-43b7-9ac1-3ecec7ded1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:44.021719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259842d-772c-43b7-9ac1-3ecec7ded1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:44.065823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b259842d-772c-43b7-9ac1-3ecec7ded1b8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:44.067143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b259842d-772c-43b7-9ac1-3ecec7ded1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:44.105801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:40:44.173888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 668/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:44.213539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0375d-c4d7-4929-9db5-a937036d85ee None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:44.215767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-51e0375d-c4d7-4929-9db5-a937036d85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:44.230990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0375d-c4d7-4929-9db5-a937036d85ee None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:44.235369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fca46-b5cc-4ea2-a2fd-1e61f36393c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:44.236020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fca46-b5cc-4ea2-a2fd-1e61f36393c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:44.236311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fca46-b5cc-4ea2-a2fd-1e61f36393c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:44.236598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fca46-b5cc-4ea2-a2fd-1e61f36393c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:44.248181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fca46-b5cc-4ea2-a2fd-1e61f36393c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:44.249681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fca46-b5cc-4ea2-a2fd-1e61f36393c9 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:44.265865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 678/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:40:48.962065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3548-d1fc-41b6-8136-99ad948ac5df None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:48.962659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3548-d1fc-41b6-8136-99ad948ac5df None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:48.962659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3548-d1fc-41b6-8136-99ad948ac5df None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:48.964021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 669/1347] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:48.969483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b4a7-62d4-451e-a7e6-ddb0c0e33e16 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:48.969932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b4a7-62d4-451e-a7e6-ddb0c0e33e16 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:48.970041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b4a7-62d4-451e-a7e6-ddb0c0e33e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:48.988931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ea22b4a7-62d4-451e-a7e6-ddb0c0e33e16 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:48.990228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ea22b4a7-62d4-451e-a7e6-ddb0c0e33e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:48.998475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 679/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:40:49.037225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3548-d1fc-41b6-8136-99ad948ac5df None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:40:49.047991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3548-d1fc-41b6-8136-99ad948ac5df None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:40:49.052301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5a72d-9ed9-4aca-a7bf-0cdcd3ec3e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:40:49.053011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a72d-9ed9-4aca-a7bf-0cdcd3ec3e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:49.053344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a72d-9ed9-4aca-a7bf-0cdcd3ec3e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:49.053634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a72d-9ed9-4aca-a7bf-0cdcd3ec3e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:49.063518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5a72d-9ed9-4aca-a7bf-0cdcd3ec3e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:40:49.065783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5a72d-9ed9-4aca-a7bf-0cdcd3ec3e56 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:40:49.075909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 670/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:40:54.099405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1265-b1e1-49f8-b47e-6f73b8b417db None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:54.100608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1265-b1e1-49f8-b47e-6f73b8b417db None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:54.101115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1265-b1e1-49f8-b47e-6f73b8b417db None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:54.103522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 680/1350] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:40:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:54.108195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145f75-edd4-4b05-b2d0-2250985b60a2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:54.108687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145f75-edd4-4b05-b2d0-2250985b60a2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:54.108771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145f75-edd4-4b05-b2d0-2250985b60a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:54.230316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7b145f75-edd4-4b05-b2d0-2250985b60a2 None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:54.231844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7b145f75-edd4-4b05-b2d0-2250985b60a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:54.339898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 671/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:58.830526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5e38-f411-488e-a9d8-9cf997b03f69 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:58.831031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5e38-f411-488e-a9d8-9cf997b03f69 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:58.831452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5e38-f411-488e-a9d8-9cf997b03f69 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:58.833466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 681/1352] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:40:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:40:58.839452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2083-ffd6-40cd-a45f-3e1b44c879db None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:40:58.840411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2083-ffd6-40cd-a45f-3e1b44c879db None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:40:58.840699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2083-ffd6-40cd-a45f-3e1b44c879db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:40:58.860071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f65d2083-ffd6-40cd-a45f-3e1b44c879db None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:40:58.862431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f65d2083-ffd6-40cd-a45f-3e1b44c879db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:40:58.871307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 672/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:40:58.983546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=13 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:00.567041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513e021-4c80-4b94-91f5-1fc872c62ef8 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:00.567684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513e021-4c80-4b94-91f5-1fc872c62ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:00.567684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513e021-4c80-4b94-91f5-1fc872c62ef8 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:00.569399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 682/1354] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:00.574750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd32fc-ae02-4be6-bcb4-032e80f472af None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:00.575212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd32fc-ae02-4be6-bcb4-032e80f472af None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:00.575433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd32fc-ae02-4be6-bcb4-032e80f472af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:00.594183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e3cd32fc-ae02-4be6-bcb4-032e80f472af None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:00.595896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e3cd32fc-ae02-4be6-bcb4-032e80f472af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:00.604272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 673/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:04.296538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe30e2a-a165-4a68-8e56-d84a2a2584d4 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:04.297808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe30e2a-a165-4a68-8e56-d84a2a2584d4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:04.299036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe30e2a-a165-4a68-8e56-d84a2a2584d4 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:04.305948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 683/1356] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:04.307423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8abec-82df-49c6-8c92-756d0ed5c582 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:04.307889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8abec-82df-49c6-8c92-756d0ed5c582 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:04.307974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8abec-82df-49c6-8c92-756d0ed5c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:04.332220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-05f8abec-82df-49c6-8c92-756d0ed5c582 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:04.334669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-05f8abec-82df-49c6-8c92-756d0ed5c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:04.348359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 674/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:04.413143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe594-dfe5-438c-804d-9d448bd1484a None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:04.416245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe594-dfe5-438c-804d-9d448bd1484a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:04.416245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe594-dfe5-438c-804d-9d448bd1484a None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:04.416245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 684/1358] 10.222.0.70 () {54 vars in 961 bytes} [Tue Jun 21 16:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:04.427815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda4ca-7345-4eeb-9491-071d75577763 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:04.428158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda4ca-7345-4eeb-9491-071d75577763 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:04.428497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdda4ca-7345-4eeb-9491-071d75577763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:04.476087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:04.484701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8cdda4ca-7345-4eeb-9491-071d75577763 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:04.488127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8cdda4ca-7345-4eeb-9491-071d75577763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:04.598320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 675/1359] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Jun 21 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:04.606534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fe594-dfe5-438c-804d-9d448bd1484a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:04.624757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fe594-dfe5-438c-804d-9d448bd1484a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:04.630909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb95c7-f433-42ba-9f45-92e1c45ab2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:04.631612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb95c7-f433-42ba-9f45-92e1c45ab2d6 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:04.631845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb95c7-f433-42ba-9f45-92e1c45ab2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:04.632317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb95c7-f433-42ba-9f45-92e1c45ab2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:04.643521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb95c7-f433-42ba-9f45-92e1c45ab2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:04.645876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb95c7-f433-42ba-9f45-92e1c45ab2d6 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:04.673491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 685/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:41:06.954201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6060db-4242-43fb-bfb4-aa90185cd35c None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:06.955311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6060db-4242-43fb-bfb4-aa90185cd35c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:06.955311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6060db-4242-43fb-bfb4-aa90185cd35c None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:06.956403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 676/1361] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:06.962007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bb8f1-1909-471f-9f83-39eafb98988f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:06.962512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bb8f1-1909-471f-9f83-39eafb98988f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:06.962987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bb8f1-1909-471f-9f83-39eafb98988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:06.983181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c33bb8f1-1909-471f-9f83-39eafb98988f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:06.984462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c33bb8f1-1909-471f-9f83-39eafb98988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:06.994526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 686/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:07.041522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6060db-4242-43fb-bfb4-aa90185cd35c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:07.057318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6060db-4242-43fb-bfb4-aa90185cd35c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:07.062823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca03a39-52a7-4664-b49b-ef7e9a4f75e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:07.064120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03a39-52a7-4664-b49b-ef7e9a4f75e7 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:07.064395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03a39-52a7-4664-b49b-ef7e9a4f75e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:07.064677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03a39-52a7-4664-b49b-ef7e9a4f75e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:07.074114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03a39-52a7-4664-b49b-ef7e9a4f75e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:07.075712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03a39-52a7-4664-b49b-ef7e9a4f75e7 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:07.087856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 677/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:09.834577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722568-bcb9-48cc-8116-f882f33c90af None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:09.835132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722568-bcb9-48cc-8116-f882f33c90af None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:09.835132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722568-bcb9-48cc-8116-f882f33c90af None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:09.836560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 687/1364] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:09.842005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fe91d-f2f8-4fd2-918b-bd114d733091 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:09.842459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fe91d-f2f8-4fd2-918b-bd114d733091 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:09.842568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fe91d-f2f8-4fd2-918b-bd114d733091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:09.862248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b47fe91d-f2f8-4fd2-918b-bd114d733091 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:09.863456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b47fe91d-f2f8-4fd2-918b-bd114d733091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:09.872026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 678/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:41:09.919767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7f22-9595-4c8a-8631-dd0a4d53daa3 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:09.920061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7f22-9595-4c8a-8631-dd0a4d53daa3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:09.920342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7f22-9595-4c8a-8631-dd0a4d53daa3 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:09.922113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 688/1366] 10.222.0.70 () {54 vars in 961 bytes} [Tue Jun 21 16:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:09.927873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69c9cb-680d-4714-ac81-3c96da6197a4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:09.928165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69c9cb-680d-4714-ac81-3c96da6197a4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:09.928477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69c9cb-680d-4714-ac81-3c96da6197a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:09.951508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3d69c9cb-680d-4714-ac81-3c96da6197a4 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:09.952763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3d69c9cb-680d-4714-ac81-3c96da6197a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:09.963406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 679/1367] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Jun 21 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:41:09.972204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7f22-9595-4c8a-8631-dd0a4d53daa3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:09.987542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7f22-9595-4c8a-8631-dd0a4d53daa3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:09.993195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8273db-2c08-4ecd-bf81-35a7f77a7238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:09.993866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8273db-2c08-4ecd-bf81-35a7f77a7238 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:09.994150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8273db-2c08-4ecd-bf81-35a7f77a7238 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:09.994429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8273db-2c08-4ecd-bf81-35a7f77a7238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:10.003790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8273db-2c08-4ecd-bf81-35a7f77a7238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:10.005213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8273db-2c08-4ecd-bf81-35a7f77a7238 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:10.015136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 689/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:12.460395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d723fa-8170-40cb-9204-c9059ed9dd22 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:12.460954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d723fa-8170-40cb-9204-c9059ed9dd22 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:12.460954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d723fa-8170-40cb-9204-c9059ed9dd22 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:12.462909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 680/1369] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:12.468738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173f37-df06-478c-bba9-d71bca75f491 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:12.469203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173f37-df06-478c-bba9-d71bca75f491 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:12.469657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173f37-df06-478c-bba9-d71bca75f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:12.489541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-a6173f37-df06-478c-bba9-d71bca75f491 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:12.490817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a6173f37-df06-478c-bba9-d71bca75f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:12.499137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 690/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:41:12.551172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d723fa-8170-40cb-9204-c9059ed9dd22 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:12.568211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d723fa-8170-40cb-9204-c9059ed9dd22 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:12.574564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933c90-a11e-4a8c-9903-f2198c62f452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:12.575366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933c90-a11e-4a8c-9903-f2198c62f452 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:12.575687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933c90-a11e-4a8c-9903-f2198c62f452 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:12.576000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933c90-a11e-4a8c-9903-f2198c62f452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:12.587531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53933c90-a11e-4a8c-9903-f2198c62f452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:12.589214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53933c90-a11e-4a8c-9903-f2198c62f452 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:12.601601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 681/1371] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:12.774987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe4d72-a79e-43bb-86b3-1c4f764c5354 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:12.775277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe4d72-a79e-43bb-86b3-1c4f764c5354 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:12.775737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe4d72-a79e-43bb-86b3-1c4f764c5354 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:12.781262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 691/1372] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:12.783256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149a455-b1a9-4f51-a3ae-219198f024ff None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:12.783630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149a455-b1a9-4f51-a3ae-219198f024ff None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:12.784113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149a455-b1a9-4f51-a3ae-219198f024ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:12.802565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a149a455-b1a9-4f51-a3ae-219198f024ff None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:12.803796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a149a455-b1a9-4f51-a3ae-219198f024ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:12.811979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 682/1373] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:41:13.165561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d8e8d-8ece-4ec8-ab84-db8700934571 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:13.165561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d8e8d-8ece-4ec8-ab84-db8700934571 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:13.165561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d8e8d-8ece-4ec8-ab84-db8700934571 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:13.168412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 692/1374] 10.222.0.70 () {54 vars in 963 bytes} [Tue Jun 21 16:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:13.173635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46d10-a136-48e4-b2ac-0374e84398ba None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:13.173635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46d10-a136-48e4-b2ac-0374e84398ba None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:13.173635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46d10-a136-48e4-b2ac-0374e84398ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:13.233198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ccf46d10-a136-48e4-b2ac-0374e84398ba None None] MFA Rules not processed for user `8f5efc58077843358aeb93e42997f2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:13.234539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ccf46d10-a136-48e4-b2ac-0374e84398ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:13.308966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 683/1375] 10.222.0.70 () {58 vars in 1060 bytes} [Tue Jun 21 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:13.317752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d8e8d-8ece-4ec8-ab84-db8700934571 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:13.328824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d8e8d-8ece-4ec8-ab84-db8700934571 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:13.333819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59c85-c62f-49cf-943e-eae59886b7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:13.334849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59c85-c62f-49cf-943e-eae59886b7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:13.335139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59c85-c62f-49cf-943e-eae59886b7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:13.335487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59c85-c62f-49cf-943e-eae59886b7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:13.345486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59c85-c62f-49cf-943e-eae59886b7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:13.347041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59c85-c62f-49cf-943e-eae59886b7f9 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:13.358707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 693/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:15.013543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373f65-38f3-4c35-89e8-b22a29151199 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:15.014092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373f65-38f3-4c35-89e8-b22a29151199 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:15.014191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373f65-38f3-4c35-89e8-b22a29151199 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:15.015536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 684/1377] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:15.021522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627294c-f602-4ba4-b2b6-57600fd9ace3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:15.021987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627294c-f602-4ba4-b2b6-57600fd9ace3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:15.022108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627294c-f602-4ba4-b2b6-57600fd9ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:15.045101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f627294c-f602-4ba4-b2b6-57600fd9ace3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:15.046384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f627294c-f602-4ba4-b2b6-57600fd9ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:15.056973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 694/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:15.102871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9373f65-38f3-4c35-89e8-b22a29151199 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:15.122411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9373f65-38f3-4c35-89e8-b22a29151199 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:15.129239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002dfd-67d0-4c23-83f5-994f20b0e246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:15.129924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002dfd-67d0-4c23-83f5-994f20b0e246 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:15.130207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002dfd-67d0-4c23-83f5-994f20b0e246 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:15.130482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002dfd-67d0-4c23-83f5-994f20b0e246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:15.139582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002dfd-67d0-4c23-83f5-994f20b0e246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:15.141191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002dfd-67d0-4c23-83f5-994f20b0e246 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:15.146238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:15.153243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 685/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:17.450738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caf261-a681-4f18-b273-db10fec60fdb None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:17.451599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caf261-a681-4f18-b273-db10fec60fdb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:17.452040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caf261-a681-4f18-b273-db10fec60fdb None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:17.456604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 695/1380] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:17.459693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192296-8fb6-4fc4-8ef3-7cbdf576dd8e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:17.460131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192296-8fb6-4fc4-8ef3-7cbdf576dd8e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:17.460259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192296-8fb6-4fc4-8ef3-7cbdf576dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:17.479574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bb192296-8fb6-4fc4-8ef3-7cbdf576dd8e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:17.480761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bb192296-8fb6-4fc4-8ef3-7cbdf576dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:17.488892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 686/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:17.535202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caf261-a681-4f18-b273-db10fec60fdb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:17.549970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caf261-a681-4f18-b273-db10fec60fdb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:17.555488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888b105-7d03-4315-8a35-1e1222d512e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:17.556257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b105-7d03-4315-8a35-1e1222d512e0 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:17.556623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b105-7d03-4315-8a35-1e1222d512e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:17.556967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b105-7d03-4315-8a35-1e1222d512e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:17.566450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b105-7d03-4315-8a35-1e1222d512e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:17.568175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b105-7d03-4315-8a35-1e1222d512e0 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:17.579049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 696/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:19.841212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb30d-b1d6-41ae-9696-9a1498fa4896 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:19.841212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb30d-b1d6-41ae-9696-9a1498fa4896 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:19.841212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb30d-b1d6-41ae-9696-9a1498fa4896 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:19.841212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 687/1383] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:19.842442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670d53f-fd88-4931-99a3-d33df8a61335 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:19.842884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670d53f-fd88-4931-99a3-d33df8a61335 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:19.843141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670d53f-fd88-4931-99a3-d33df8a61335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:19.865442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8670d53f-fd88-4931-99a3-d33df8a61335 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:19.866628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8670d53f-fd88-4931-99a3-d33df8a61335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:19.874869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 697/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:19.916603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb30d-b1d6-41ae-9696-9a1498fa4896 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:19.933047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb30d-b1d6-41ae-9696-9a1498fa4896 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:19.939547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2eab7-fd8c-4724-8791-058c3c5fae5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:19.940330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2eab7-fd8c-4724-8791-058c3c5fae5f service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:19.940715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2eab7-fd8c-4724-8791-058c3c5fae5f service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:19.941199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2eab7-fd8c-4724-8791-058c3c5fae5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:19.950367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2eab7-fd8c-4724-8791-058c3c5fae5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:19.952184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2eab7-fd8c-4724-8791-058c3c5fae5f service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:19.962836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 688/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:22.260704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af903e-d52d-4a2e-8b52-742e0b44966f None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:22.261313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af903e-d52d-4a2e-8b52-742e0b44966f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:22.261473 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af903e-d52d-4a2e-8b52-742e0b44966f None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:22.263658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 698/1386] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:22.270994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876dd5-7283-4793-8d95-da1099806b6d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:22.271548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876dd5-7283-4793-8d95-da1099806b6d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:22.271548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876dd5-7283-4793-8d95-da1099806b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:22.292317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f2876dd5-7283-4793-8d95-da1099806b6d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:22.293957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f2876dd5-7283-4793-8d95-da1099806b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:22.303670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 689/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:22.360841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af903e-d52d-4a2e-8b52-742e0b44966f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:22.379902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af903e-d52d-4a2e-8b52-742e0b44966f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:22.385486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb04e2e-528c-478c-8176-090e844eabfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:22.386131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb04e2e-528c-478c-8176-090e844eabfc service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:22.386421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb04e2e-528c-478c-8176-090e844eabfc service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:22.386731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb04e2e-528c-478c-8176-090e844eabfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:22.396051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb04e2e-528c-478c-8176-090e844eabfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:22.397678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb04e2e-528c-478c-8176-090e844eabfc service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:22.408429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 699/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:24.640255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4975-84f0-4dda-88c3-0763125b67b9 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:24.640865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4975-84f0-4dda-88c3-0763125b67b9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:24.640865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4975-84f0-4dda-88c3-0763125b67b9 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:24.642568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 690/1389] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:24.648702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9201401-824c-4e2b-9864-1b51070c3018 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:24.649163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9201401-824c-4e2b-9864-1b51070c3018 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:24.649512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9201401-824c-4e2b-9864-1b51070c3018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:24.674516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c9201401-824c-4e2b-9864-1b51070c3018 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:24.676145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c9201401-824c-4e2b-9864-1b51070c3018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:24.686485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 700/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:24.733086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4975-84f0-4dda-88c3-0763125b67b9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:24.748283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4975-84f0-4dda-88c3-0763125b67b9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:24.754147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11389b84-3be5-45dd-b94e-1aaf149c7d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:24.754911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11389b84-3be5-45dd-b94e-1aaf149c7d7b service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:24.755197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11389b84-3be5-45dd-b94e-1aaf149c7d7b service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:24.755482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11389b84-3be5-45dd-b94e-1aaf149c7d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:24.764236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11389b84-3be5-45dd-b94e-1aaf149c7d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:24.766189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11389b84-3be5-45dd-b94e-1aaf149c7d7b service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:24.775649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 691/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:26.958584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f1089-e4eb-4fc8-8204-9b0f0a94c12c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:26.959121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f1089-e4eb-4fc8-8204-9b0f0a94c12c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:26.959333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f1089-e4eb-4fc8-8204-9b0f0a94c12c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:26.961303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 701/1392] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:26.966377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928dbfc-2e64-43f8-a291-7dc23646cb5d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:26.966990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928dbfc-2e64-43f8-a291-7dc23646cb5d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:26.966990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928dbfc-2e64-43f8-a291-7dc23646cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:26.986799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3928dbfc-2e64-43f8-a291-7dc23646cb5d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:26.988037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3928dbfc-2e64-43f8-a291-7dc23646cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:26.996044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 692/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:27.040924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f1089-e4eb-4fc8-8204-9b0f0a94c12c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:27.056195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f1089-e4eb-4fc8-8204-9b0f0a94c12c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:27.061802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc51b2-ca10-435d-8d9c-7de4c1a4a4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:27.062937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc51b2-ca10-435d-8d9c-7de4c1a4a4be service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:27.063224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc51b2-ca10-435d-8d9c-7de4c1a4a4be service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:27.063505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc51b2-ca10-435d-8d9c-7de4c1a4a4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:27.072020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc51b2-ca10-435d-8d9c-7de4c1a4a4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:27.073653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc51b2-ca10-435d-8d9c-7de4c1a4a4be service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:27.084455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 702/1394] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:41:29.193763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc8f0-12b6-4782-8793-870f30516143 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.194304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc8f0-12b6-4782-8793-870f30516143 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.194304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc8f0-12b6-4782-8793-870f30516143 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.195731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 693/1395] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:29.201157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7afa1a-f2b5-4083-8900-db8c78120efb None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.201672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7afa1a-f2b5-4083-8900-db8c78120efb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.201785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7afa1a-f2b5-4083-8900-db8c78120efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.208020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=52 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:29.219852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3c7afa1a-f2b5-4083-8900-db8c78120efb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:29.220973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3c7afa1a-f2b5-4083-8900-db8c78120efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:29.229140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 703/1396] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:29.286488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38451-d7b4-4267-b032-9773ffd8cfeb None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.286778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38451-d7b4-4267-b032-9773ffd8cfeb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.287055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38451-d7b4-4267-b032-9773ffd8cfeb None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.288548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 694/1397] 10.222.0.70 () {54 vars in 962 bytes} [Tue Jun 21 16:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:29.294007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.294306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.294594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.317407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a295e69-751f-4620-a7f4-1f73d103ac6a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.317806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a295e69-751f-4620-a7f4-1f73d103ac6a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.318186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a295e69-751f-4620-a7f4-1f73d103ac6a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.319692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 695/1398] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:41:29.324650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.324941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.325231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.342727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:29.344462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:29.345947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] MFA Rules not processed for user `1eee79db5d38448fb7e3c40be668a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:29.347859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:29.352692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 696/1399] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:41:29.397164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:29.410096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2b48-e4bc-438b-9f25-2cb0fad419de None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:29.410431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 704/1400] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Jun 21 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:29.415656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422adad8-d1ed-4d69-a31c-97679d85166a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:29.416301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422adad8-d1ed-4d69-a31c-97679d85166a service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.416586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422adad8-d1ed-4d69-a31c-97679d85166a service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.416943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422adad8-d1ed-4d69-a31c-97679d85166a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.417818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:29.426013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca65860-8328-43c2-acdc-1b46950612f9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:29.426325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422adad8-d1ed-4d69-a31c-97679d85166a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:29.427921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422adad8-d1ed-4d69-a31c-97679d85166a service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:29.429665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010387dc-71f8-4fcc-b0ee-d3086c71c9f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:29.430301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010387dc-71f8-4fcc-b0ee-d3086c71c9f8 service glance] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:29.430591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010387dc-71f8-4fcc-b0ee-d3086c71c9f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:29.430880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010387dc-71f8-4fcc-b0ee-d3086c71c9f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:29.437694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 697/1401] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:41:29.440300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010387dc-71f8-4fcc-b0ee-d3086c71c9f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:29.441780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010387dc-71f8-4fcc-b0ee-d3086c71c9f8 service glance] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:29.451374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 705/1402] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:41:30.303707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f341-53d8-458c-9f28-e695db91725c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:30.304413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f341-53d8-458c-9f28-e695db91725c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:30.304413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f341-53d8-458c-9f28-e695db91725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:30.356291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6761f341-53d8-458c-9f28-e695db91725c None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:30.357580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6761f341-53d8-458c-9f28-e695db91725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:30.436352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 698/1403] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:30.478767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5637d3-ac6c-48e8-976e-09b8e74b6667 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:30.479230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5637d3-ac6c-48e8-976e-09b8e74b6667 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:30.479515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5637d3-ac6c-48e8-976e-09b8e74b6667 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:30.481130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 706/1404] 10.222.0.70 () {54 vars in 942 bytes} [Tue Jun 21 16:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:30.487790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7493d-2858-4c36-a7c1-530af90589ab None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:30.488185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7493d-2858-4c36-a7c1-530af90589ab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:30.488534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7493d-2858-4c36-a7c1-530af90589ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:30.539723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-acd7493d-2858-4c36-a7c1-530af90589ab None None] MFA Rules not processed for user `4f3bfddef4664aad9d210fbeb52acda9`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:30.540944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-acd7493d-2858-4c36-a7c1-530af90589ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:30.575248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:30.615494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 699/1405] 10.222.0.70 () {58 vars in 1039 bytes} [Tue Jun 21 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:41:30.624592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5637d3-ac6c-48e8-976e-09b8e74b6667 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:30.638499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5637d3-ac6c-48e8-976e-09b8e74b6667 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:30.644282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321de1a-f925-421e-b295-3b93cc8d239d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:30.644929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321de1a-f925-421e-b295-3b93cc8d239d service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:30.645220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321de1a-f925-421e-b295-3b93cc8d239d service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:30.645567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321de1a-f925-421e-b295-3b93cc8d239d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:30.653914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321de1a-f925-421e-b295-3b93cc8d239d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:30.655487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321de1a-f925-421e-b295-3b93cc8d239d service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:30.664703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 707/1406] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:41:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:41:31.684863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38a7a-156a-49c5-9b15-6c2f866fb82b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:31.685418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38a7a-156a-49c5-9b15-6c2f866fb82b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:31.685418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38a7a-156a-49c5-9b15-6c2f866fb82b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:31.686814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 700/1407] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:31.692207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3a45-9446-495c-b731-5babad6bb7fb None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:31.692639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3a45-9446-495c-b731-5babad6bb7fb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:31.692776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3a45-9446-495c-b731-5babad6bb7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:31.713160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-fe0b3a45-9446-495c-b731-5babad6bb7fb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:31.714959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-fe0b3a45-9446-495c-b731-5babad6bb7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:31.725110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 708/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:31.770596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38a7a-156a-49c5-9b15-6c2f866fb82b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:31.788071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38a7a-156a-49c5-9b15-6c2f866fb82b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:31.793979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309d2b-6de5-485b-8b2d-0a85032879c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:31.794703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309d2b-6de5-485b-8b2d-0a85032879c5 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:31.795067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309d2b-6de5-485b-8b2d-0a85032879c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:31.795412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309d2b-6de5-485b-8b2d-0a85032879c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:31.805539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27309d2b-6de5-485b-8b2d-0a85032879c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:31.807223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27309d2b-6de5-485b-8b2d-0a85032879c5 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:31.819830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 701/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:41.706170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=55 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:41.815896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=21 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:55.254014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05040-e7a0-4721-87e0-2cc58bb347b0 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:55.254660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05040-e7a0-4721-87e0-2cc58bb347b0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:55.254660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05040-e7a0-4721-87e0-2cc58bb347b0 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:55.256011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 709/1410] 10.222.0.70 () {54 vars in 918 bytes} [Tue Jun 21 16:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:55.262819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847213ec-854e-413c-af85-5c01a4918c59 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:55.262819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847213ec-854e-413c-af85-5c01a4918c59 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:55.262819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847213ec-854e-413c-af85-5c01a4918c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:55.280880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-847213ec-854e-413c-af85-5c01a4918c59 None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:55.282158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-847213ec-854e-413c-af85-5c01a4918c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:55.293718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 702/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Jun 21 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:55.306433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6141-2d03-4496-8f3d-c3bda0f83cb7 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:55.306898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6141-2d03-4496-8f3d-c3bda0f83cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:55.307030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6141-2d03-4496-8f3d-c3bda0f83cb7 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:55.308403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 710/1412] 10.222.0.70 () {54 vars in 918 bytes} [Tue Jun 21 16:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:55.313409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c526-69ef-4c49-9afa-22a9d6815a00 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:55.313707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c526-69ef-4c49-9afa-22a9d6815a00 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:55.313994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c526-69ef-4c49-9afa-22a9d6815a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:55.334126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1960c526-69ef-4c49-9afa-22a9d6815a00 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:55.335343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1960c526-69ef-4c49-9afa-22a9d6815a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:55.345030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 703/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Jun 21 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:57.937122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9746e-b763-4633-a789-4f58baa39ef3 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:57.937705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9746e-b763-4633-a789-4f58baa39ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:57.937705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9746e-b763-4633-a789-4f58baa39ef3 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:57.939094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:41:57.944494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580697-a597-4986-bcd6-62bcf26b8ac8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:57.944920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580697-a597-4986-bcd6-62bcf26b8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:57.945044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580697-a597-4986-bcd6-62bcf26b8ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:57.962944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-89580697-a597-4986-bcd6-62bcf26b8ac8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:57.964149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-89580697-a597-4986-bcd6-62bcf26b8ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:57.972899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:58.015840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9746e-b763-4633-a789-4f58baa39ef3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:58.030071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9746e-b763-4633-a789-4f58baa39ef3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:58.036159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048b4d3-de45-4d8e-8d56-e6629e8fdee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:58.036796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048b4d3-de45-4d8e-8d56-e6629e8fdee6 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:58.037086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048b4d3-de45-4d8e-8d56-e6629e8fdee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:58.037408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048b4d3-de45-4d8e-8d56-e6629e8fdee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:58.045544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048b4d3-de45-4d8e-8d56-e6629e8fdee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:58.047123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048b4d3-de45-4d8e-8d56-e6629e8fdee6 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:58.057407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 712/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:58.969566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f18056-972c-4b97-a941-9970333cef55 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:58.970110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f18056-972c-4b97-a941-9970333cef55 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:58.970110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f18056-972c-4b97-a941-9970333cef55 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:58.972051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:41:58.976891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a7aa-9c61-41ed-a3f4-550316b2d2b5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:58.977344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a7aa-9c61-41ed-a3f4-550316b2d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:58.977491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a7aa-9c61-41ed-a3f4-550316b2d2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:58.996857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5af0a7aa-9c61-41ed-a3f4-550316b2d2b5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:41:58.998096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5af0a7aa-9c61-41ed-a3f4-550316b2d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:41:59.006593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:41:59.165354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f18056-972c-4b97-a941-9970333cef55 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:41:59.180466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f18056-972c-4b97-a941-9970333cef55 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:41:59.186007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d5447-d649-4ec6-a84b-f9d4c211e957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:41:59.186644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d5447-d649-4ec6-a84b-f9d4c211e957 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:41:59.186935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d5447-d649-4ec6-a84b-f9d4c211e957 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:41:59.187219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d5447-d649-4ec6-a84b-f9d4c211e957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:41:59.196350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d5447-d649-4ec6-a84b-f9d4c211e957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:41:59.198005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d5447-d649-4ec6-a84b-f9d4c211e957 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:41:59.207872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 706/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:00.093973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7741f16-0d5a-4597-8d64-131b7dacaf39 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:00.094542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7741f16-0d5a-4597-8d64-131b7dacaf39 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:00.094542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7741f16-0d5a-4597-8d64-131b7dacaf39 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:00.096055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:00.101529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef3468-fca3-4277-a209-15a3497b7ee2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:00.102112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef3468-fca3-4277-a209-15a3497b7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:00.102112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef3468-fca3-4277-a209-15a3497b7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:00.120278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1cef3468-fca3-4277-a209-15a3497b7ee2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:00.121550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1cef3468-fca3-4277-a209-15a3497b7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:00.130184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:00.283721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7741f16-0d5a-4597-8d64-131b7dacaf39 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:00.300116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7741f16-0d5a-4597-8d64-131b7dacaf39 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:00.305682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58877f7d-90a4-4ef2-adc7-a3224b52cb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:00.306319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877f7d-90a4-4ef2-adc7-a3224b52cb3d service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:00.306603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877f7d-90a4-4ef2-adc7-a3224b52cb3d service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:00.306881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877f7d-90a4-4ef2-adc7-a3224b52cb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:00.315827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58877f7d-90a4-4ef2-adc7-a3224b52cb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:00.319665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58877f7d-90a4-4ef2-adc7-a3224b52cb3d service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:00.326692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 715/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:01.189805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935369ee-ea02-4329-8804-3c5a0fdb4084 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:01.190356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935369ee-ea02-4329-8804-3c5a0fdb4084 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:01.190456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935369ee-ea02-4329-8804-3c5a0fdb4084 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:01.191816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:01.196915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded028b-6587-491c-8911-6277ed103979 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:01.197404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded028b-6587-491c-8911-6277ed103979 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:01.197505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded028b-6587-491c-8911-6277ed103979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:01.215121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-dded028b-6587-491c-8911-6277ed103979 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:01.216315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-dded028b-6587-491c-8911-6277ed103979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:01.224357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:01.374604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935369ee-ea02-4329-8804-3c5a0fdb4084 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:01.389699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935369ee-ea02-4329-8804-3c5a0fdb4084 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:01.395356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb6cbd-6d7f-403f-8168-40889807ab2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:01.395990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb6cbd-6d7f-403f-8168-40889807ab2e service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:01.396278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb6cbd-6d7f-403f-8168-40889807ab2e service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:01.396561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb6cbd-6d7f-403f-8168-40889807ab2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:01.404698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb6cbd-6d7f-403f-8168-40889807ab2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:01.406329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb6cbd-6d7f-403f-8168-40889807ab2e service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:01.416059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 709/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:02.296142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e04e-708c-4790-9187-d2fec3dd470b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:02.296644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e04e-708c-4790-9187-d2fec3dd470b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:02.296760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e04e-708c-4790-9187-d2fec3dd470b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:02.298352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:02.303543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bef32-1c50-4cc4-af03-e0cc6eaa819d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:02.303971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bef32-1c50-4cc4-af03-e0cc6eaa819d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:02.304098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bef32-1c50-4cc4-af03-e0cc6eaa819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:02.323006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-df2bef32-1c50-4cc4-af03-e0cc6eaa819d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:02.324210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-df2bef32-1c50-4cc4-af03-e0cc6eaa819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:02.332908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:02.483433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e04e-708c-4790-9187-d2fec3dd470b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:02.497866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e04e-708c-4790-9187-d2fec3dd470b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:02.503825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cfc22-28b3-4def-99d3-5c1386ce0724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:02.504403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cfc22-28b3-4def-99d3-5c1386ce0724 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:02.504689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cfc22-28b3-4def-99d3-5c1386ce0724 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:02.504969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cfc22-28b3-4def-99d3-5c1386ce0724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:02.512993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cfc22-28b3-4def-99d3-5c1386ce0724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:02.514709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cfc22-28b3-4def-99d3-5c1386ce0724 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:02.524870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 718/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:03.414361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d04c6-06c2-4a65-8f0f-73ec377da76b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:03.414933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d04c6-06c2-4a65-8f0f-73ec377da76b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:03.414933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d04c6-06c2-4a65-8f0f-73ec377da76b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:03.416328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:03.421368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61f24-ebbe-4508-906a-70811447de47 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:03.421774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61f24-ebbe-4508-906a-70811447de47 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:03.421932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61f24-ebbe-4508-906a-70811447de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:03.439932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-dea61f24-ebbe-4508-906a-70811447de47 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:03.441139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-dea61f24-ebbe-4508-906a-70811447de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:03.448957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:03.600928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d04c6-06c2-4a65-8f0f-73ec377da76b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:03.615233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d04c6-06c2-4a65-8f0f-73ec377da76b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:03.620592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bca7b3-6bbf-4366-b34f-d93899ca6717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:03.621227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bca7b3-6bbf-4366-b34f-d93899ca6717 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:03.621546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bca7b3-6bbf-4366-b34f-d93899ca6717 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:03.621836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bca7b3-6bbf-4366-b34f-d93899ca6717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:03.630246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bca7b3-6bbf-4366-b34f-d93899ca6717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:03.631860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bca7b3-6bbf-4366-b34f-d93899ca6717 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:03.643008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 712/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:04.556061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a2c0-f616-41bc-b93b-9db11683a7d6 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:04.556771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a2c0-f616-41bc-b93b-9db11683a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:04.556771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a2c0-f616-41bc-b93b-9db11683a7d6 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:04.558048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:04.562947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80bb16-8a0d-4517-96a2-1ce6510e8ed2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:04.563411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80bb16-8a0d-4517-96a2-1ce6510e8ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:04.563586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80bb16-8a0d-4517-96a2-1ce6510e8ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:04.581939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-af80bb16-8a0d-4517-96a2-1ce6510e8ed2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:04.583284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-af80bb16-8a0d-4517-96a2-1ce6510e8ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:04.591409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:04.743234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a2c0-f616-41bc-b93b-9db11683a7d6 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:04.757830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a2c0-f616-41bc-b93b-9db11683a7d6 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:04.763380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe0662-2385-44df-a9bc-25c1ad28f3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:04.764049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0662-2385-44df-a9bc-25c1ad28f3a0 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:04.764339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0662-2385-44df-a9bc-25c1ad28f3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:04.764643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0662-2385-44df-a9bc-25c1ad28f3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:04.773780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe0662-2385-44df-a9bc-25c1ad28f3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:04.775357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe0662-2385-44df-a9bc-25c1ad28f3a0 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:04.785222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 721/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:05.676560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7efc-1f5b-44d0-a34d-4045d09090ef None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:05.677122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7efc-1f5b-44d0-a34d-4045d09090ef None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:05.677122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7efc-1f5b-44d0-a34d-4045d09090ef None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:05.678559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:05.683537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d848-c65f-4638-b054-b13c8269b0f0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:05.683980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d848-c65f-4638-b054-b13c8269b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:05.684096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d848-c65f-4638-b054-b13c8269b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:05.702244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-7f36d848-c65f-4638-b054-b13c8269b0f0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:05.703446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7f36d848-c65f-4638-b054-b13c8269b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:05.711143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:05.863898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7efc-1f5b-44d0-a34d-4045d09090ef None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:05.878998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7efc-1f5b-44d0-a34d-4045d09090ef None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:05.884354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4698d-417e-45f8-b1d0-b7636772f7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:05.884994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4698d-417e-45f8-b1d0-b7636772f7ef service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:05.885298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4698d-417e-45f8-b1d0-b7636772f7ef service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:05.885598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4698d-417e-45f8-b1d0-b7636772f7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:05.893860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4698d-417e-45f8-b1d0-b7636772f7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:05.895456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4698d-417e-45f8-b1d0-b7636772f7ef service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:05.904962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 715/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:06.817423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f624-9404-451c-aece-d26ef34712d0 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:06.817988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f624-9404-451c-aece-d26ef34712d0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:06.817988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f624-9404-451c-aece-d26ef34712d0 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:06.819398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:06.824468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cfe10-7bed-4162-8b0c-8c3df1190d7b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:06.824911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cfe10-7bed-4162-8b0c-8c3df1190d7b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:06.825126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cfe10-7bed-4162-8b0c-8c3df1190d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:06.843057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b17cfe10-7bed-4162-8b0c-8c3df1190d7b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:06.844187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b17cfe10-7bed-4162-8b0c-8c3df1190d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:06.852797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:07.002368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634f624-9404-451c-aece-d26ef34712d0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:07.016218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634f624-9404-451c-aece-d26ef34712d0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:07.022793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eab465-e85d-4e5f-aa08-60b76584337c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:07.023468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab465-e85d-4e5f-aa08-60b76584337c service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:07.023759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab465-e85d-4e5f-aa08-60b76584337c service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:07.024045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab465-e85d-4e5f-aa08-60b76584337c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:07.032900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab465-e85d-4e5f-aa08-60b76584337c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:07.034667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab465-e85d-4e5f-aa08-60b76584337c service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:07.044065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 724/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:42:09.004761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05412f-9f3b-4e38-83a7-5bf1114a52c9 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:09.005397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05412f-9f3b-4e38-83a7-5bf1114a52c9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:09.005397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05412f-9f3b-4e38-83a7-5bf1114a52c9 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:09.006765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:09.012278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc52bd-89fd-4175-a9ae-36a43bc379ab None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:09.012784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc52bd-89fd-4175-a9ae-36a43bc379ab None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:09.012896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc52bd-89fd-4175-a9ae-36a43bc379ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:09.030662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5efc52bd-89fd-4175-a9ae-36a43bc379ab None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:09.032454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5efc52bd-89fd-4175-a9ae-36a43bc379ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:09.040210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:09.079044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05412f-9f3b-4e38-83a7-5bf1114a52c9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:09.089988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05412f-9f3b-4e38-83a7-5bf1114a52c9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:09.093472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d9763-68a6-47f2-8f6e-299dddcae6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:09.094098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9763-68a6-47f2-8f6e-299dddcae6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:09.094922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9763-68a6-47f2-8f6e-299dddcae6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:09.095224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d9763-68a6-47f2-8f6e-299dddcae6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:09.104328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d9763-68a6-47f2-8f6e-299dddcae6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:09.105798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d9763-68a6-47f2-8f6e-299dddcae6e6 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:09.116261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 718/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:11.323951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad8c8-82b6-49e4-b7ca-da82055e451e None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:11.324481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad8c8-82b6-49e4-b7ca-da82055e451e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:11.324609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad8c8-82b6-49e4-b7ca-da82055e451e None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:11.326035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:11.332742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757eddf-47d1-4558-ab0b-816b1c6551c3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:11.333190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757eddf-47d1-4558-ab0b-816b1c6551c3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:11.333310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757eddf-47d1-4558-ab0b-816b1c6551c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:11.351518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2757eddf-47d1-4558-ab0b-816b1c6551c3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:11.352735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2757eddf-47d1-4558-ab0b-816b1c6551c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:11.361013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:11.400236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad8c8-82b6-49e4-b7ca-da82055e451e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:11.411312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad8c8-82b6-49e4-b7ca-da82055e451e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:11.417522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e5e4-3059-4821-9b9c-918cc0caf7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:11.417522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e5e4-3059-4821-9b9c-918cc0caf7ad service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:11.417522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e5e4-3059-4821-9b9c-918cc0caf7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:11.417522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e5e4-3059-4821-9b9c-918cc0caf7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:11.425746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e5e4-3059-4821-9b9c-918cc0caf7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:11.427177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e5e4-3059-4821-9b9c-918cc0caf7ad service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:11.436815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 727/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:14.004568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8709f-c4fb-4db6-9546-4351565affca None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:14.005147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8709f-c4fb-4db6-9546-4351565affca None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:14.005147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8709f-c4fb-4db6-9546-4351565affca None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:14.006560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:14.012082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de090-8b3d-41e7-ab78-539cd51cfb9c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:14.012532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de090-8b3d-41e7-ab78-539cd51cfb9c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:14.012627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de090-8b3d-41e7-ab78-539cd51cfb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:14.031107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b07de090-8b3d-41e7-ab78-539cd51cfb9c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:14.032986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b07de090-8b3d-41e7-ab78-539cd51cfb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:14.040762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:42:14.080906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8709f-c4fb-4db6-9546-4351565affca None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:14.092416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8709f-c4fb-4db6-9546-4351565affca None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:14.096683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91e931-05e1-4eea-a027-bb776365b857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:14.097403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91e931-05e1-4eea-a027-bb776365b857 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:14.097694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91e931-05e1-4eea-a027-bb776365b857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:14.097974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91e931-05e1-4eea-a027-bb776365b857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:14.107524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91e931-05e1-4eea-a027-bb776365b857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:14.108972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91e931-05e1-4eea-a027-bb776365b857 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:14.120716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 721/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:42:16.352774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d756a9-a0ec-408b-baae-d0ba6616b572 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:16.353432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d756a9-a0ec-408b-baae-d0ba6616b572 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:16.353432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d756a9-a0ec-408b-baae-d0ba6616b572 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:16.354690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:16.360363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f1bb-7e30-410d-ad1d-0a728f96f218 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:16.360782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f1bb-7e30-410d-ad1d-0a728f96f218 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:16.360916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f1bb-7e30-410d-ad1d-0a728f96f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:16.379871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-79b5f1bb-7e30-410d-ad1d-0a728f96f218 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:16.381093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-79b5f1bb-7e30-410d-ad1d-0a728f96f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:16.389199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:42:16.429297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d756a9-a0ec-408b-baae-d0ba6616b572 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:16.441021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d756a9-a0ec-408b-baae-d0ba6616b572 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:16.444882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcccc0-75c1-4e6e-a4bb-e5918d23126e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:16.445559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcccc0-75c1-4e6e-a4bb-e5918d23126e service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:16.445853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcccc0-75c1-4e6e-a4bb-e5918d23126e service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:16.446136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcccc0-75c1-4e6e-a4bb-e5918d23126e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:16.455539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcccc0-75c1-4e6e-a4bb-e5918d23126e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:16.456968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcccc0-75c1-4e6e-a4bb-e5918d23126e service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:16.466407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 730/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:18.564918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761318e7-82b8-438a-85dd-4dfddf6574b1 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:18.565566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761318e7-82b8-438a-85dd-4dfddf6574b1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:18.565566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761318e7-82b8-438a-85dd-4dfddf6574b1 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:18.566850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:18.571976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6417def-5473-4221-b729-9e097e2c4a4f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:18.572452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6417def-5473-4221-b729-9e097e2c4a4f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:18.572564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6417def-5473-4221-b729-9e097e2c4a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:18.590334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e6417def-5473-4221-b729-9e097e2c4a4f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:18.591539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e6417def-5473-4221-b729-9e097e2c4a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:18.599922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:18.638964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761318e7-82b8-438a-85dd-4dfddf6574b1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:18.651117 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761318e7-82b8-438a-85dd-4dfddf6574b1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:18.654729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b7d56-b9df-4976-b2a4-50e5ca483c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:18.655363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b7d56-b9df-4976-b2a4-50e5ca483c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:18.655651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b7d56-b9df-4976-b2a4-50e5ca483c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:18.655931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b7d56-b9df-4976-b2a4-50e5ca483c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:18.665384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b7d56-b9df-4976-b2a4-50e5ca483c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:18.666828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b7d56-b9df-4976-b2a4-50e5ca483c43 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:18.676597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 724/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:20.802570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16610-ac64-4d5f-8d19-e33a459395f5 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:20.803156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16610-ac64-4d5f-8d19-e33a459395f5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:20.803156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16610-ac64-4d5f-8d19-e33a459395f5 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:20.804551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:42:20.810334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbd21-7c83-45c8-aafc-3e6c7d42700c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:20.810909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbd21-7c83-45c8-aafc-3e6c7d42700c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:20.810909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbd21-7c83-45c8-aafc-3e6c7d42700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:20.829518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6a1cbd21-7c83-45c8-aafc-3e6c7d42700c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:20.830747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6a1cbd21-7c83-45c8-aafc-3e6c7d42700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:20.838679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:42:20.879352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16610-ac64-4d5f-8d19-e33a459395f5 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:20.891735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16610-ac64-4d5f-8d19-e33a459395f5 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:20.895513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d5f4f-44be-48a9-bceb-1cc289def048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:20.896209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5f4f-44be-48a9-bceb-1cc289def048 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:20.896509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5f4f-44be-48a9-bceb-1cc289def048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:20.896867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d5f4f-44be-48a9-bceb-1cc289def048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:20.913269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d5f4f-44be-48a9-bceb-1cc289def048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:20.914735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d5f4f-44be-48a9-bceb-1cc289def048 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:20.925660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 733/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:23.097981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094946-64bb-4193-b543-222e93efd09c None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:23.098560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094946-64bb-4193-b543-222e93efd09c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:23.098560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094946-64bb-4193-b543-222e93efd09c None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:23.099931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:23.105128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88f33a-acf1-4bf5-b785-caa42c67e041 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:23.105560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88f33a-acf1-4bf5-b785-caa42c67e041 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:23.105735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88f33a-acf1-4bf5-b785-caa42c67e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:23.112413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=70 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:42:23.124162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ff88f33a-acf1-4bf5-b785-caa42c67e041 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:23.126220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ff88f33a-acf1-4bf5-b785-caa42c67e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:23.134540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:23.172622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094946-64bb-4193-b543-222e93efd09c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:23.178147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=73 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:42:23.183838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094946-64bb-4193-b543-222e93efd09c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:23.188124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f6ee8-fc36-4ff4-ad46-0b0cc74c9a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:23.188797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6ee8-fc36-4ff4-ad46-0b0cc74c9a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:23.189082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6ee8-fc36-4ff4-ad46-0b0cc74c9a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:23.189420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6ee8-fc36-4ff4-ad46-0b0cc74c9a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:23.199134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f6ee8-fc36-4ff4-ad46-0b0cc74c9a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:23.200650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f6ee8-fc36-4ff4-ad46-0b0cc74c9a86 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:23.210817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 727/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:25.312805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65220a5-72b2-4ad6-ab4a-136ef3c7a5b7 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:25.313389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65220a5-72b2-4ad6-ab4a-136ef3c7a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:25.313389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65220a5-72b2-4ad6-ab4a-136ef3c7a5b7 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:25.314800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:25.320424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330ebf-b160-4135-9666-7bb0aba4a39d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:25.320959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330ebf-b160-4135-9666-7bb0aba4a39d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:25.321095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330ebf-b160-4135-9666-7bb0aba4a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:25.338933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0b330ebf-b160-4135-9666-7bb0aba4a39d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:25.340145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0b330ebf-b160-4135-9666-7bb0aba4a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:25.348967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:25.386352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65220a5-72b2-4ad6-ab4a-136ef3c7a5b7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:25.397919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65220a5-72b2-4ad6-ab4a-136ef3c7a5b7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:25.401694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270203f4-852f-4819-8c52-57c42d631f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:25.402358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270203f4-852f-4819-8c52-57c42d631f7c service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:25.402644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270203f4-852f-4819-8c52-57c42d631f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:25.402940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270203f4-852f-4819-8c52-57c42d631f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:25.414089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270203f4-852f-4819-8c52-57c42d631f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:25.415529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270203f4-852f-4819-8c52-57c42d631f7c service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:25.425464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 736/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:27.548471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedda93-2caf-42d7-992b-f9926c33367b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:27.548990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedda93-2caf-42d7-992b-f9926c33367b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:27.548990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedda93-2caf-42d7-992b-f9926c33367b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:27.550436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:27.555810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513ea3e-2265-4737-a417-1731bbd82d69 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:27.556243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513ea3e-2265-4737-a417-1731bbd82d69 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:27.556388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513ea3e-2265-4737-a417-1731bbd82d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:27.574756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5513ea3e-2265-4737-a417-1731bbd82d69 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:27.575952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5513ea3e-2265-4737-a417-1731bbd82d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:27.584731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:27.622028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedda93-2caf-42d7-992b-f9926c33367b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:27.632882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedda93-2caf-42d7-992b-f9926c33367b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:27.636396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c5a70-c6e8-49f1-b340-18580588544c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:27.637026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c5a70-c6e8-49f1-b340-18580588544c service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:27.637350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c5a70-c6e8-49f1-b340-18580588544c service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:27.637635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c5a70-c6e8-49f1-b340-18580588544c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:27.646938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c5a70-c6e8-49f1-b340-18580588544c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:27.648373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c5a70-c6e8-49f1-b340-18580588544c service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:27.658431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 730/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:29.733258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7258-1622-4f95-9bfd-3fe1bbb868f2 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:29.734368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7258-1622-4f95-9bfd-3fe1bbb868f2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:29.734368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7258-1622-4f95-9bfd-3fe1bbb868f2 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:29.735845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:29.741555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb6f0d-a032-4c7b-aff5-d67579d527ad None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:29.742052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb6f0d-a032-4c7b-aff5-d67579d527ad None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:29.742188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb6f0d-a032-4c7b-aff5-d67579d527ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:29.762841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-78eb6f0d-a032-4c7b-aff5-d67579d527ad None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:29.764065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-78eb6f0d-a032-4c7b-aff5-d67579d527ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:29.773346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:29.810620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7258-1622-4f95-9bfd-3fe1bbb868f2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:29.831172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7258-1622-4f95-9bfd-3fe1bbb868f2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:29.831172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8c71-fa75-4fd2-8a1e-c61dbac1a50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:29.831172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8c71-fa75-4fd2-8a1e-c61dbac1a50f service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:29.831172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8c71-fa75-4fd2-8a1e-c61dbac1a50f service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:29.831662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8c71-fa75-4fd2-8a1e-c61dbac1a50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:29.839409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8c71-fa75-4fd2-8a1e-c61dbac1a50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:29.840841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8c71-fa75-4fd2-8a1e-c61dbac1a50f service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:29.851029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 739/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:39.755274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=17 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:42:39.846842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=17 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:42:50.070465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d62ab-6109-45d4-b469-b65c5f2bbff7 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:50.071055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d62ab-6109-45d4-b469-b65c5f2bbff7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:50.071166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d62ab-6109-45d4-b469-b65c5f2bbff7 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:50.072561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 732/1471] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:50.079436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e309-6f7c-4f0a-92a5-daa99b0a9414 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:50.079909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e309-6f7c-4f0a-92a5-daa99b0a9414 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:50.080019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e309-6f7c-4f0a-92a5-daa99b0a9414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:50.100974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4e84e309-6f7c-4f0a-92a5-daa99b0a9414 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:50.102351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4e84e309-6f7c-4f0a-92a5-daa99b0a9414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:50.112519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 740/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:50.161612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75614f7b-43ef-4059-8fe6-45574bec8d58 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:50.161906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75614f7b-43ef-4059-8fe6-45574bec8d58 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:50.162189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75614f7b-43ef-4059-8fe6-45574bec8d58 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:50.163686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 733/1473] 10.222.0.70 () {54 vars in 962 bytes} [Tue Jun 21 16:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:50.168612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f289412-6cde-4381-95ba-95d4e57c70e9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:50.168906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f289412-6cde-4381-95ba-95d4e57c70e9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:50.169190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f289412-6cde-4381-95ba-95d4e57c70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:50.187427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3f289412-6cde-4381-95ba-95d4e57c70e9 None None] MFA Rules not processed for user `1eee79db5d38448fb7e3c40be668a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:50.188621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3f289412-6cde-4381-95ba-95d4e57c70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:50.195295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 741/1474] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Jun 21 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:50.203404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75614f7b-43ef-4059-8fe6-45574bec8d58 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:50.214784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75614f7b-43ef-4059-8fe6-45574bec8d58 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:50.245159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735cc3-7a51-4877-98fa-58f297bd09b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:50.245159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735cc3-7a51-4877-98fa-58f297bd09b7 service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:50.245159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735cc3-7a51-4877-98fa-58f297bd09b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:50.245159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735cc3-7a51-4877-98fa-58f297bd09b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:50.245636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735cc3-7a51-4877-98fa-58f297bd09b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:50.245636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735cc3-7a51-4877-98fa-58f297bd09b7 service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:50.245636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 734/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:52.456601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2e39-25c1-4d8d-9277-39310980b83b None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:52.457137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2e39-25c1-4d8d-9277-39310980b83b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:52.457137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2e39-25c1-4d8d-9277-39310980b83b None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:52.458627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 742/1476] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:52.464017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081912-f68f-4ce8-925a-11eb46acb760 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:52.464450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081912-f68f-4ce8-925a-11eb46acb760 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:52.464584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081912-f68f-4ce8-925a-11eb46acb760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:52.483396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5d081912-f68f-4ce8-925a-11eb46acb760 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:52.484651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5d081912-f68f-4ce8-925a-11eb46acb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:52.492604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 735/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:52.518521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc2e39-25c1-4d8d-9277-39310980b83b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:52.531970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc2e39-25c1-4d8d-9277-39310980b83b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:52.538348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:42:52.544617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:42:52.545271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd63171-9568-4edf-a804-f6a51f4d19db admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:52.563966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 743/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Jun 21 16:42:52 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:42:54.692703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e0bb-d59c-485d-ab58-0979088e67a4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:54.693264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e0bb-d59c-485d-ab58-0979088e67a4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:54.693264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e0bb-d59c-485d-ab58-0979088e67a4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:54.694820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 736/1479] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:54.700165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc47b8-d5a5-46b2-8e13-a43c97e5b967 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:54.700597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc47b8-d5a5-46b2-8e13-a43c97e5b967 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:54.700713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc47b8-d5a5-46b2-8e13-a43c97e5b967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:54.720809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-23dc47b8-d5a5-46b2-8e13-a43c97e5b967 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:54.722053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-23dc47b8-d5a5-46b2-8e13-a43c97e5b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:54.730102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 744/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:54.775639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e0bb-d59c-485d-ab58-0979088e67a4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:54.790941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e0bb-d59c-485d-ab58-0979088e67a4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:54.797502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c884-51a0-43af-9fac-78b5cb39e71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:54.800658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c884-51a0-43af-9fac-78b5cb39e71a service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:54.800658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c884-51a0-43af-9fac-78b5cb39e71a service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:54.800658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c884-51a0-43af-9fac-78b5cb39e71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:54.807102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18c884-51a0-43af-9fac-78b5cb39e71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:54.808563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18c884-51a0-43af-9fac-78b5cb39e71a service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:54.822472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 737/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:57.107879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1e3c-b3be-4a2c-ad00-4a38530c972c None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:57.108472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1e3c-b3be-4a2c-ad00-4a38530c972c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:57.108472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1e3c-b3be-4a2c-ad00-4a38530c972c None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:57.110020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 745/1482] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:57.115614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfb38-7f4a-4f57-9d66-698c87058739 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:57.116087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfb38-7f4a-4f57-9d66-698c87058739 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:57.116203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfb38-7f4a-4f57-9d66-698c87058739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:57.135263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-688dfb38-7f4a-4f57-9d66-698c87058739 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:57.136474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-688dfb38-7f4a-4f57-9d66-698c87058739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:57.145291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 738/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:57.182208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f1e3c-b3be-4a2c-ad00-4a38530c972c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:57.193477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f1e3c-b3be-4a2c-ad00-4a38530c972c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:57.196936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03eb1f-deeb-4f3e-b8bd-fc16e82717ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:57.197607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03eb1f-deeb-4f3e-b8bd-fc16e82717ce service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:57.197893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03eb1f-deeb-4f3e-b8bd-fc16e82717ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:57.198173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03eb1f-deeb-4f3e-b8bd-fc16e82717ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:57.208235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03eb1f-deeb-4f3e-b8bd-fc16e82717ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:57.209702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03eb1f-deeb-4f3e-b8bd-fc16e82717ce service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:57.219217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 746/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:59.334645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5057fb-1a18-46fc-a723-086ce240c9c8 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:59.335207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5057fb-1a18-46fc-a723-086ce240c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:59.335207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5057fb-1a18-46fc-a723-086ce240c9c8 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:59.336600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 739/1485] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:42:59.342652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fd5a-7b51-4463-acd1-309749cdb4d6 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:59.343099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fd5a-7b51-4463-acd1-309749cdb4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:59.343214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fd5a-7b51-4463-acd1-309749cdb4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:59.478936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4373fd5a-7b51-4463-acd1-309749cdb4d6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:42:59.480176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4373fd5a-7b51-4463-acd1-309749cdb4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:42:59.488745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 747/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:42:59.527387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5057fb-1a18-46fc-a723-086ce240c9c8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:42:59.538581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5057fb-1a18-46fc-a723-086ce240c9c8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:42:59.542176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b053fc-f9d9-4879-94d4-d5ca32152316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:42:59.542812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b053fc-f9d9-4879-94d4-d5ca32152316 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:42:59.543102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b053fc-f9d9-4879-94d4-d5ca32152316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:42:59.543384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b053fc-f9d9-4879-94d4-d5ca32152316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:42:59.553298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b053fc-f9d9-4879-94d4-d5ca32152316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:42:59.554772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b053fc-f9d9-4879-94d4-d5ca32152316 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:42:59.565040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 740/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:43:01.742607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443897d0-33b2-4dcf-a0d9-4238dd1556cc None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:43:01.743122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443897d0-33b2-4dcf-a0d9-4238dd1556cc None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:43:01.743122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443897d0-33b2-4dcf-a0d9-4238dd1556cc None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:43:01.744550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 748/1488] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:43:01.750104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b502c-7252-41c1-9bc8-6b8fbea29024 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:43:01.750512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b502c-7252-41c1-9bc8-6b8fbea29024 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:43:01.750706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b502c-7252-41c1-9bc8-6b8fbea29024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:43:01.768424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3a3b502c-7252-41c1-9bc8-6b8fbea29024 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:43:01.769679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a3b502c-7252-41c1-9bc8-6b8fbea29024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:43:01.777928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 741/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:43:01.819284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443897d0-33b2-4dcf-a0d9-4238dd1556cc None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:43:01.830624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443897d0-33b2-4dcf-a0d9-4238dd1556cc None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:43:01.834183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63b9c6-9fdd-4d45-b893-7e0d519e88f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:43:01.834812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63b9c6-9fdd-4d45-b893-7e0d519e88f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:43:01.835109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63b9c6-9fdd-4d45-b893-7e0d519e88f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:43:01.835367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63b9c6-9fdd-4d45-b893-7e0d519e88f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:43:01.845267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63b9c6-9fdd-4d45-b893-7e0d519e88f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:43:01.846697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63b9c6-9fdd-4d45-b893-7e0d519e88f5 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:43:01.855953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 749/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:43:04.281747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9ad1c-a4c3-4870-97cd-3e545469baab None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:43:04.282256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9ad1c-a4c3-4870-97cd-3e545469baab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:43:04.282355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9ad1c-a4c3-4870-97cd-3e545469baab None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:43:04.283689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 742/1491] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jun 21 16:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:43:04.289032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9a12-79bf-46f4-86fd-975e1ca39f35 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:43:04.289473 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9a12-79bf-46f4-86fd-975e1ca39f35 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:43:04.289591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9a12-79bf-46f4-86fd-975e1ca39f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:43:04.307794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1a2b9a12-79bf-46f4-86fd-975e1ca39f35 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:43:04.308978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1a2b9a12-79bf-46f4-86fd-975e1ca39f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:43:04.317932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 750/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Jun 21 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:43:04.358209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9ad1c-a4c3-4870-97cd-3e545469baab None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:43:04.368895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9ad1c-a4c3-4870-97cd-3e545469baab None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:43:04.373034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72fe11-d832-4e98-8a91-401c9aa5760e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:43:04.373666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72fe11-d832-4e98-8a91-401c9aa5760e service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:43:04.373955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72fe11-d832-4e98-8a91-401c9aa5760e service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:43:04.374240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72fe11-d832-4e98-8a91-401c9aa5760e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:43:04.383719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72fe11-d832-4e98-8a91-401c9aa5760e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:43:04.385153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72fe11-d832-4e98-8a91-401c9aa5760e service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:43:04.395913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 743/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:43:14.303154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=33 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:43:14.391600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=33 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:44:39.159788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.160428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.160428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.179346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:44:39.180505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:39.188496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 751/1494] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:44:39.198469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.198992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.199098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.217443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:44:39.218680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:39.226766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 744/1495] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:44:39.231218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.242463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce62d-367c-46a9-a1f5-5ccd5b1c7bef None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.246157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.246813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.247098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.247410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.248143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:44:39.248486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.249536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:39.249536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:44:39.249536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:44:39.250444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:39.265891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 752/1496] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:44:39.271365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.280995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e562-dca3-4add-99db-98fbe66a29a5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.285534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.286258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.286551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.286831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.287545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.289619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:39.289619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:44:39.289619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:44:39.290826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:39.419358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 745/1497] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:44:39 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:44:39.423480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.434998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3b69-21da-44bd-a35d-71b785ef6e0d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.492322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.492978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.493316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.493603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.494299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.495311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:39.495311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:44:39.495311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:44:39.496501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:39.576806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 753/1498] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:44:39 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:44:39.580911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.592329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd709-7d3f-47d4-8424-574799146b7d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.596986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.597759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.598048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.598329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.599053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.600079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:39.600079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:44:39.600079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:44:39.600960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:39.613903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 746/1499] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:44:39.618739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.628554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334b48f-9e52-4336-baee-99af41587d5f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.633620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.634303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.634593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.634877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.635605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.636619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:39.636619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:44:39.636619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:44:39.637566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d7f8-9071-4c9f-9fcc-65202ce52e86 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:39.651605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 754/1500] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:44:39.655766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.665754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662362a-e1ba-47ff-999b-cb40a95915ca admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.670540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.671417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.671703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.671982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] PATH_INFO: `/v3/projects/e87a67f4e1de496bb0992d1f4d80bc06/users/4d56e2bf36b64449a6a5782dd9832169/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.687021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87a67f4e1de496bb0992d1f4d80bc06, user_id=4d56e2bf36b64449a6a5782dd9832169, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.687997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:39.687997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:44:39.687997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:44:39.689967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738af51-cba9-401b-936d-65b605176871 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:39.760712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 747/1501] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:44:39 2022] PUT /identity/v3/projects/e87a67f4e1de496bb0992d1f4d80bc06/users/4d56e2bf36b64449a6a5782dd9832169/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:44:39.772208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea973d-5eb2-45a0-8e48-a5ddcc9783be None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.772522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea973d-5eb2-45a0-8e48-a5ddcc9783be None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.772811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea973d-5eb2-45a0-8e48-a5ddcc9783be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.800395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3dea973d-5eb2-45a0-8e48-a5ddcc9783be None None] MFA Rules not processed for user `4d56e2bf36b64449a6a5782dd9832169`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:44:39.801656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3dea973d-5eb2-45a0-8e48-a5ddcc9783be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:39.865569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 755/1502] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:44:39.879591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998c3a-8e6c-4337-8005-70dc36ede0b4 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.879883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998c3a-8e6c-4337-8005-70dc36ede0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.880164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998c3a-8e6c-4337-8005-70dc36ede0b4 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.881642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 748/1503] 10.222.0.70 () {54 vars in 963 bytes} [Tue Jun 21 16:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:44:39.887402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf19b7-dcc8-4e0f-a4be-ec9fe118e284 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.887694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf19b7-dcc8-4e0f-a4be-ec9fe118e284 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.887997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf19b7-dcc8-4e0f-a4be-ec9fe118e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.905879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-70cf19b7-dcc8-4e0f-a4be-ec9fe118e284 None None] MFA Rules not processed for user `8f5efc58077843358aeb93e42997f2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:44:39.907106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-70cf19b7-dcc8-4e0f-a4be-ec9fe118e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:39.950848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:44:39.958403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 756/1504] 10.222.0.70 () {58 vars in 1060 bytes} [Tue Jun 21 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:44:39.966822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71998c3a-8e6c-4337-8005-70dc36ede0b4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:39.977653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71998c3a-8e6c-4337-8005-70dc36ede0b4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:39.981217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:39.981884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:39.982179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:39.982462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:39.991064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:39.992995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:40.001844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 749/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:44:40.051447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896734-a3b8-443f-8c09-fee3964fbeb6 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:40.051746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896734-a3b8-443f-8c09-fee3964fbeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:40.052033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896734-a3b8-443f-8c09-fee3964fbeb6 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:40.053427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 757/1506] 10.222.0.70 () {52 vars in 829 bytes} [Tue Jun 21 16:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:44:40.057658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:40.120811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8af3c-4c65-48b4-a05f-aee9cbc75944 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:40.125403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:40.126269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:40.126556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:40.126833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] PATH_INFO: `/v3/users/4d56e2bf36b64449a6a5782dd9832169` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:40.128001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d56e2bf36b64449a6a5782dd9832169)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:40.129019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:40.129019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:44:40.129019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:44:40.130288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:40.326072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d56e2bf36b64449a6a5782dd9832169'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:40.340126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d56e2bf36b64449a6a5782dd9832169'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:40.341240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d56e2bf36b64449a6a5782dd9832169'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:40.341980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d56e2bf36b64449a6a5782dd9832169'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:40.368205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d56e2bf36b64449a6a5782dd9832169'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:40.373240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:44:40.473393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 750/1507] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:44:40 2022] DELETE /identity/v3/users/4d56e2bf36b64449a6a5782dd9832169 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:44:40.479200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:40.479755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:40.479852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:40.498347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:44:40.499649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:40.559686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 758/1508] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:44:40.569626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:40.572281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:40.630211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e723e2d-57e8-495c-bd6d-fceda2aac300 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:40.634479 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418052b3-b54a-424c-bd6d-a696cb3e1b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:40.635133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418052b3-b54a-424c-bd6d-a696cb3e1b97 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:40.635418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418052b3-b54a-424c-bd6d-a696cb3e1b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:40.635703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418052b3-b54a-424c-bd6d-a696cb3e1b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:40.644885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418052b3-b54a-424c-bd6d-a696cb3e1b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:40.646486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418052b3-b54a-424c-bd6d-a696cb3e1b97 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:40.656111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 751/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:44:41.176633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:44:41.181862 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:44:41.191081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cc89c-a8eb-42c1-9be2-55f8ebf90653 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:44:41.196071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:44:41.197051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:44:41.197715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:44:41.197996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] PATH_INFO: `/v3/projects/e87a67f4e1de496bb0992d1f4d80bc06` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:44:41.199216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87a67f4e1de496bb0992d1f4d80bc06)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:44:41.200235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:44:41.200235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:44:41.200235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:44:41.201467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:44:41.312942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87a67f4e1de496bb0992d1f4d80bc06', 'request_id': 'req-70f393fa-9650-4d27-8022-d508c43b45fe'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:41.405565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87a67f4e1de496bb0992d1f4d80bc06', 'request_id': 'req-70f393fa-9650-4d27-8022-d508c43b45fe'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:41.413568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87a67f4e1de496bb0992d1f4d80bc06', 'request_id': 'req-70f393fa-9650-4d27-8022-d508c43b45fe'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:41.432708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] The token cache is being invalidate because project e87a67f4e1de496bb0992d1f4d80bc06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:44:41.432926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:41.433720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-70f393fa-9650-4d27-8022-d508c43b45fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:44:41.435280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 759/1510] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:44:41 2022] DELETE /identity/v3/projects/e87a67f4e1de496bb0992d1f4d80bc06 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:44:50.651859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:44:51.430173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:23.395419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c1d27-7e52-4053-8488-8f0188c89f51 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:23.396020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c1d27-7e52-4053-8488-8f0188c89f51 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:23.396020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c1d27-7e52-4053-8488-8f0188c89f51 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:23.397467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:23.402181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bfde2-6679-4eb8-bc48-86759e0900d5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:23.402611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bfde2-6679-4eb8-bc48-86759e0900d5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:23.402742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bfde2-6679-4eb8-bc48-86759e0900d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:23.421638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-221bfde2-6679-4eb8-bc48-86759e0900d5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:23.422839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-221bfde2-6679-4eb8-bc48-86759e0900d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:23.480577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:23.636513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c1d27-7e52-4053-8488-8f0188c89f51 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:23.638366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-214c1d27-7e52-4053-8488-8f0188c89f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:23.715614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c1d27-7e52-4053-8488-8f0188c89f51 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:23.721741 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f629ff3-e194-4db6-9a9f-2c6ed5d6ce7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:23.722392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629ff3-e194-4db6-9a9f-2c6ed5d6ce7c service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:23.722683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629ff3-e194-4db6-9a9f-2c6ed5d6ce7c service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:23.722964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629ff3-e194-4db6-9a9f-2c6ed5d6ce7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:23.731082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f629ff3-e194-4db6-9a9f-2c6ed5d6ce7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:23.732798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f629ff3-e194-4db6-9a9f-2c6ed5d6ce7c service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:23.742372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 753/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:24.581806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15c4fb-7ecb-4b4e-95cd-f21ababc789f None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:24.582297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15c4fb-7ecb-4b4e-95cd-f21ababc789f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:24.584247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15c4fb-7ecb-4b4e-95cd-f21ababc789f None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:24.584247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:24.589106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266673-af1a-45a4-8d33-540ffaaa2fb1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:24.589593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266673-af1a-45a4-8d33-540ffaaa2fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:24.589704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266673-af1a-45a4-8d33-540ffaaa2fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:24.609024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3c266673-af1a-45a4-8d33-540ffaaa2fb1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:24.610268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3c266673-af1a-45a4-8d33-540ffaaa2fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:24.618080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:24.777294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15c4fb-7ecb-4b4e-95cd-f21ababc789f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:24.792506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15c4fb-7ecb-4b4e-95cd-f21ababc789f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:24.798513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc58cd8-6cc1-4e3d-bae3-0a466ed208d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:24.799153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58cd8-6cc1-4e3d-bae3-0a466ed208d4 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:24.799441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58cd8-6cc1-4e3d-bae3-0a466ed208d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:24.799726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58cd8-6cc1-4e3d-bae3-0a466ed208d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:24.808426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc58cd8-6cc1-4e3d-bae3-0a466ed208d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:24.810211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc58cd8-6cc1-4e3d-bae3-0a466ed208d4 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:24.819928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 762/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:26.464432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0dc5-cb85-4012-8450-c764862d84ff None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:26.464974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0dc5-cb85-4012-8450-c764862d84ff None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:26.464974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0dc5-cb85-4012-8450-c764862d84ff None None] PATH_INFO: `/v3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:26.466972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 755/1517] 10.222.0.47 () {54 vars in 925 bytes} [Tue Jun 21 16:46:26 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:46:26.473334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79de5c3-a40a-41a3-a3ae-297774d4673d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:26.473755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79de5c3-a40a-41a3-a3ae-297774d4673d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:26.473908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79de5c3-a40a-41a3-a3ae-297774d4673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:26.492701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b79de5c3-a40a-41a3-a3ae-297774d4673d None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:26.493941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b79de5c3-a40a-41a3-a3ae-297774d4673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:26.557133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 763/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Jun 21 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:30.766420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaab3-b254-41f8-bc13-52fb5e8bd3e0 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:30.766901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaab3-b254-41f8-bc13-52fb5e8bd3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:30.767006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaab3-b254-41f8-bc13-52fb5e8bd3e0 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:30.768392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 756/1519] 10.222.0.70 () {54 vars in 960 bytes} [Tue Jun 21 16:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:30.773498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a81d46-168c-4bf3-8e28-d0ced7f19a95 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:30.773943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a81d46-168c-4bf3-8e28-d0ced7f19a95 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:30.774059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a81d46-168c-4bf3-8e28-d0ced7f19a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:30.793306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-33a81d46-168c-4bf3-8e28-d0ced7f19a95 None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:30.795422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-33a81d46-168c-4bf3-8e28-d0ced7f19a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:30.804084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 764/1520] 10.222.0.70 () {58 vars in 1057 bytes} [Tue Jun 21 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:30.812398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaab3-b254-41f8-bc13-52fb5e8bd3e0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:30.825715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaab3-b254-41f8-bc13-52fb5e8bd3e0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:30.831180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091b171-a1de-4539-90c6-6c0839a6adc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:30.831810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091b171-a1de-4539-90c6-6c0839a6adc7 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:30.832098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091b171-a1de-4539-90c6-6c0839a6adc7 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:30.832380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091b171-a1de-4539-90c6-6c0839a6adc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:30.841672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091b171-a1de-4539-90c6-6c0839a6adc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:30.843317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091b171-a1de-4539-90c6-6c0839a6adc7 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:30.852889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 757/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:36.047630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21ab95-e2c5-4971-8744-380154a49897 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:36.048181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21ab95-e2c5-4971-8744-380154a49897 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:36.048181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21ab95-e2c5-4971-8744-380154a49897 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:36.049633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:36.054425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89442-2467-45a0-ade7-50792688ea7f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:36.054820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89442-2467-45a0-ade7-50792688ea7f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:36.055025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89442-2467-45a0-ade7-50792688ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:36.073738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1ff89442-2467-45a0-ade7-50792688ea7f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:36.074986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1ff89442-2467-45a0-ade7-50792688ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:36.083102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:36.239071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21ab95-e2c5-4971-8744-380154a49897 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:36.254016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21ab95-e2c5-4971-8744-380154a49897 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:36.259494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f87aa2-95f2-40f4-a5d8-7af86effef20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:36.260142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87aa2-95f2-40f4-a5d8-7af86effef20 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:36.260471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87aa2-95f2-40f4-a5d8-7af86effef20 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:36.260892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87aa2-95f2-40f4-a5d8-7af86effef20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:36.271954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87aa2-95f2-40f4-a5d8-7af86effef20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:36.273675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87aa2-95f2-40f4-a5d8-7af86effef20 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:36.283980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 766/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:37.103125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706710-f153-4b2b-8cf9-1a770fc6ba80 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:37.103702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706710-f153-4b2b-8cf9-1a770fc6ba80 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:37.103702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706710-f153-4b2b-8cf9-1a770fc6ba80 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:37.105080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 16:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:37.110084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8144053-e303-4545-a3b1-5b2dc09b5eec None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:37.110533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8144053-e303-4545-a3b1-5b2dc09b5eec None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:37.110649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8144053-e303-4545-a3b1-5b2dc09b5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:37.129350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c8144053-e303-4545-a3b1-5b2dc09b5eec None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:37.130530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c8144053-e303-4545-a3b1-5b2dc09b5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:37.139320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 16:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:37.297928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7706710-f153-4b2b-8cf9-1a770fc6ba80 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:37.312823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7706710-f153-4b2b-8cf9-1a770fc6ba80 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:37.318209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3cba2-3257-4044-ae4c-618c589b368c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:37.318852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3cba2-3257-4044-ae4c-618c589b368c service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:37.319143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3cba2-3257-4044-ae4c-618c589b368c service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:37.319429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3cba2-3257-4044-ae4c-618c589b368c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:37.327976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3cba2-3257-4044-ae4c-618c589b368c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:37.329686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3cba2-3257-4044-ae4c-618c589b368c service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:37.339847 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 760/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:41.825304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639dd3-7c4d-4c6f-a92d-f6e8ab062e51 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:41.825963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639dd3-7c4d-4c6f-a92d-f6e8ab062e51 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:41.825963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639dd3-7c4d-4c6f-a92d-f6e8ab062e51 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:41.827297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:46:41.832803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c68d-1556-4eeb-93f5-ae12b02e47d7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:41.833389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c68d-1556-4eeb-93f5-ae12b02e47d7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:41.833389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c68d-1556-4eeb-93f5-ae12b02e47d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:41.851828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4d59c68d-1556-4eeb-93f5-ae12b02e47d7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:41.853028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4d59c68d-1556-4eeb-93f5-ae12b02e47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:41.861035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:46:41.898189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639dd3-7c4d-4c6f-a92d-f6e8ab062e51 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:41.899874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2d639dd3-7c4d-4c6f-a92d-f6e8ab062e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:41.957241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639dd3-7c4d-4c6f-a92d-f6e8ab062e51 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:41.960860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958646cc-c205-4c0b-9de7-8a18c14238d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:41.961802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958646cc-c205-4c0b-9de7-8a18c14238d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:41.962087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958646cc-c205-4c0b-9de7-8a18c14238d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:41.962514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958646cc-c205-4c0b-9de7-8a18c14238d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:41.972116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958646cc-c205-4c0b-9de7-8a18c14238d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:41.973576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958646cc-c205-4c0b-9de7-8a18c14238d4 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:41.978430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:41.983299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 769/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:44.078018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c304-e52e-4db0-9b97-d6a6fdc6737e None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:44.078877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c304-e52e-4db0-9b97-d6a6fdc6737e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:44.079084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c304-e52e-4db0-9b97-d6a6fdc6737e None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:44.080808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:46:44.086534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1fca-521c-4aec-b217-a61c2f21b23e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:44.087003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1fca-521c-4aec-b217-a61c2f21b23e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:44.087143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1fca-521c-4aec-b217-a61c2f21b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:44.106629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-951a1fca-521c-4aec-b217-a61c2f21b23e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:44.107850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-951a1fca-521c-4aec-b217-a61c2f21b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:44.115934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:44.154062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59c304-e52e-4db0-9b97-d6a6fdc6737e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:44.165348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59c304-e52e-4db0-9b97-d6a6fdc6737e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:44.169472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4598467-2dc7-4296-91b7-766a5410d752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:44.170102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598467-2dc7-4296-91b7-766a5410d752 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:44.170411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598467-2dc7-4296-91b7-766a5410d752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:44.170717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598467-2dc7-4296-91b7-766a5410d752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:44.179923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4598467-2dc7-4296-91b7-766a5410d752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:44.181439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4598467-2dc7-4296-91b7-766a5410d752 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:44.191570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 763/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:47.869787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c06a3-90a6-4655-89c5-6e192480310a None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:47.870412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c06a3-90a6-4655-89c5-6e192480310a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:47.870412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c06a3-90a6-4655-89c5-6e192480310a None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:47.871974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:47.877207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8285143-7ed5-4af8-a35c-36365e7a4c1e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:47.877695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8285143-7ed5-4af8-a35c-36365e7a4c1e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:47.877810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8285143-7ed5-4af8-a35c-36365e7a4c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:47.896040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b8285143-7ed5-4af8-a35c-36365e7a4c1e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:47.897250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b8285143-7ed5-4af8-a35c-36365e7a4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:47.905844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:46:48.217165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c06a3-90a6-4655-89c5-6e192480310a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:48.218882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-659c06a3-90a6-4655-89c5-6e192480310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:48.392698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c06a3-90a6-4655-89c5-6e192480310a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:48.392698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7dad5-97c8-4e6d-93a5-89fad061c0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:48.392698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7dad5-97c8-4e6d-93a5-89fad061c0ea service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:48.392698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7dad5-97c8-4e6d-93a5-89fad061c0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:48.393705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7dad5-97c8-4e6d-93a5-89fad061c0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:48.393705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7dad5-97c8-4e6d-93a5-89fad061c0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:48.393705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7dad5-97c8-4e6d-93a5-89fad061c0ea service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:48.393705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 772/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:46:50.440316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ab32-7a51-4e55-8ebf-ee0aafa244e9 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:50.440862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ab32-7a51-4e55-8ebf-ee0aafa244e9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:50.440862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ab32-7a51-4e55-8ebf-ee0aafa244e9 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:50.442237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 16:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:46:50.447496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd153-a01e-40e2-8343-5a1b0d8262e0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:50.447939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd153-a01e-40e2-8343-5a1b0d8262e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:50.448044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd153-a01e-40e2-8343-5a1b0d8262e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:50.467157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-05afd153-a01e-40e2-8343-5a1b0d8262e0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:46:50.468355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-05afd153-a01e-40e2-8343-5a1b0d8262e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:50.476155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:46:50.790509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ab32-7a51-4e55-8ebf-ee0aafa244e9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:46:50.792707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4228ab32-7a51-4e55-8ebf-ee0aafa244e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:46:50.800939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=65 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:50.807128 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ab32-7a51-4e55-8ebf-ee0aafa244e9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:46:50.812156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656b7b5-7f4c-408d-9879-1066d100d867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:46:50.815176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656b7b5-7f4c-408d-9879-1066d100d867 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:46:50.815176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656b7b5-7f4c-408d-9879-1066d100d867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:46:50.815176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656b7b5-7f4c-408d-9879-1066d100d867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:46:50.824089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656b7b5-7f4c-408d-9879-1066d100d867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:46:50.825669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656b7b5-7f4c-408d-9879-1066d100d867 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:46:50.837786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 766/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:47:00.462029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=32 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:47:00.836169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:21.602692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a211d-8e9e-40ec-9aa7-e05403a5279e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.611122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a211d-8e9e-40ec-9aa7-e05403a5279e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.611122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a211d-8e9e-40ec-9aa7-e05403a5279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.618815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a972d-e432-470c-88c8-67d39a61b1cf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.620081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a972d-e432-470c-88c8-67d39a61b1cf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.621040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a972d-e432-470c-88c8-67d39a61b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.632246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8e9a211d-8e9e-40ec-9aa7-e05403a5279e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:21.633524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8e9a211d-8e9e-40ec-9aa7-e05403a5279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:21.645506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-eb4a972d-e432-470c-88c8-67d39a61b1cf None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:21.646725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eb4a972d-e432-470c-88c8-67d39a61b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:21.653929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 774/1540] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:21.659475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.659822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.660049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.662098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 767/1541] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:21.672534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.672854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.673106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.698920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:21.700262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:21.706065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:21.707779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:21.716809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 775/1542] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:48:21.721523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:21.723092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 768/1543] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:48:21.727727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:21.735345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b448-dfde-4933-ab8a-f25328833212 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:21.744060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7adc4-627c-4d0b-81d8-e1ea5e4aa7eb None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:21.744918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:21.746430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.746727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.747012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.747762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:21.748083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:21.749733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45329af3-4898-4b56-b238-1f27bc360f46 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:21.752877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:21.753592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.753887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.754175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.754916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:21.755232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:21.756277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:48:21.756277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:48:21.756277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:48:21.757198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d0e2d-eacb-4775-8a18-2e84888bef13 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:21.775554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 776/1544] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:48:21.778604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 769/1545] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:48:21.779932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.780221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.780501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.781687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.782010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.782452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.810209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:21.811420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:21.816675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:21.817910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:21.831845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 770/1547] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:21.832316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 777/1547] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:21.832949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:21.837010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:21.851819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f527e-f4bd-48ac-b7d2-cd61c811a31b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:21.854408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7905f4-9694-4824-8a6b-cde13ae23537 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:21.864161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:21.866170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.866455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.866742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.867472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:21.867819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eba9e-7458-4fd4-8ae8-18c0e5401565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:21.868776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eba9e-7458-4fd4-8ae8-18c0e5401565 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.868985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:48:21.868985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:48:21.868985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:48:21.869692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eba9e-7458-4fd4-8ae8-18c0e5401565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.870334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eba9e-7458-4fd4-8ae8-18c0e5401565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:21.870899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efcce5-0513-4554-a0f8-0dd4a62e991a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:21.871966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eba9e-7458-4fd4-8ae8-18c0e5401565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:21.874328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eba9e-7458-4fd4-8ae8-18c0e5401565 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:21.979036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 778/1548] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:21.982161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bd42-3b49-4102-9b16-c8fe345fe356 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:21.982688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bd42-3b49-4102-9b16-c8fe345fe356 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:21.983271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bd42-3b49-4102-9b16-c8fe345fe356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.012956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d076bd42-3b49-4102-9b16-c8fe345fe356 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.014258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d076bd42-3b49-4102-9b16-c8fe345fe356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.023636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 771/1549] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.024960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b0b16-812c-43dc-8aff-3187eb564a99 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.034397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b0b16-812c-43dc-8aff-3187eb564a99 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.034397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b0b16-812c-43dc-8aff-3187eb564a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.045324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ba1b0b16-812c-43dc-8aff-3187eb564a99 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.046486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ba1b0b16-812c-43dc-8aff-3187eb564a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.079503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 779/1550] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.080796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dee6d-1814-41de-bc04-57084b460b2d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.081085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dee6d-1814-41de-bc04-57084b460b2d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.081399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dee6d-1814-41de-bc04-57084b460b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.100919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b32dee6d-1814-41de-bc04-57084b460b2d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.102158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b32dee6d-1814-41de-bc04-57084b460b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.116739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 772/1551] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.116739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.116739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.116739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.131707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.132907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.141672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 773/1552] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.142427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.156477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0af0b-5c78-4958-a252-d2606c0dd6e9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.161313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.161984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.162272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.162551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.163258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.164266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:48:22.164266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:48:22.164266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:48:22.165514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.166674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 780/1553] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.170645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e517-747f-4dd2-be54-1df5484dfc76 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.170938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e517-747f-4dd2-be54-1df5484dfc76 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.171353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e517-747f-4dd2-be54-1df5484dfc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.189467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-cee5e517-747f-4dd2-be54-1df5484dfc76 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.190743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cee5e517-747f-4dd2-be54-1df5484dfc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.199126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 781/1554] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.200407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.200693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.200970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.219481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.220664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.228412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 782/1555] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.229143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.238515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753460e-8df1-4e61-a860-2ba8c61e96a4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.243662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03088e7c-dc51-4707-bde9-5ddf87a1380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.243798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03088e7c-dc51-4707-bde9-5ddf87a1380f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.243960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03088e7c-dc51-4707-bde9-5ddf87a1380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.244240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03088e7c-dc51-4707-bde9-5ddf87a1380f admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.248036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 774/1556] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.248266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03088e7c-dc51-4707-bde9-5ddf87a1380f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.248377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.248469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03088e7c-dc51-4707-bde9-5ddf87a1380f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.255461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365aea9-cb2b-4b46-94a9-d0f85b65a793 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.261473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.262299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.262585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.262861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.265646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:22.265646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.265646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.280792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 775/1557] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:22.281673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.292898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea12d20-7932-44db-9915-9eea8864ec48 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.298653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.299441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.299878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.300209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.301049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:22.301465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.303360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ced480-570c-4e13-bc3d-01b2570c4ab1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.316076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 776/1558] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:22.317745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab75b13-1da9-45af-8d58-2318936065af None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.318042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab75b13-1da9-45af-8d58-2318936065af None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.318373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab75b13-1da9-45af-8d58-2318936065af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.332202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 783/1559] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.334430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950108b-bc1d-4416-899f-647a189514b2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.334873 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950108b-bc1d-4416-899f-647a189514b2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.335164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950108b-bc1d-4416-899f-647a189514b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.343115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6ab75b13-1da9-45af-8d58-2318936065af None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.344374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6ab75b13-1da9-45af-8d58-2318936065af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.352671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 777/1560] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.354196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8950108b-bc1d-4416-899f-647a189514b2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.354590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.354881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.355161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.356415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8950108b-bc1d-4416-899f-647a189514b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.365049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 784/1561] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.366658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.367003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.367231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.374728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.375931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.384258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 778/1562] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.385038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.389014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:22.390396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:22.395801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d88c-8530-4244-8331-9d2b5e4d3a3a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.398976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 785/1563] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:22.399810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.404602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.405219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:22.405441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.405557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.405827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.406564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.408212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.410946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e94d-4c57-498e-a758-b3d71bc5c1d2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.415636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.423129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.423129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.423129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.423129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.423528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 779/1564] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:22.423624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.423702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.429742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081722a9-31cd-4535-b1bb-37f6513b69f1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.436361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.437030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.437357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.437642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.438345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.440341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.540322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 786/1565] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.540322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.554731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 780/1566] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.556520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.567440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:22.606083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89925269-2f91-4bde-aaca-9851dfa8861c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.621601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950e71a-5171-4b15-a3b7-b1311188cc0b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.626439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.627344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.627681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.628308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.629217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:22.629631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.631789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.645532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 781/1567] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:22.646647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.657073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bded6f-35bb-42ba-9db8-d814f189ae07 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.662468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.663543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.663836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.664120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.664884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:22.665240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.667017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.673721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.674403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.674701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.674988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.675731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.677409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.681677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 782/1568] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:22.683391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.691128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 787/1569] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:22.691128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.696311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a1f0-cc95-47ef-9d88-8c20c184ff62 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.700684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f200c9-3efb-46e9-970e-f5450ae6c02f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.701734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.702398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.702689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.702975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.703715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:22.704036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.705713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.705846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.706496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.706785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.707320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.708214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:22.709031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.710668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.718291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 783/1570] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:22.719346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.724968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 788/1571] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:22.725820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.731032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36203-0a4d-4336-8c9c-6e106bfadf96 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.736002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.736720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.737011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.737316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.738049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.739666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.741698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba3c42-7687-4cb7-99cf-b9c8a4926c06 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.746937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.747606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.747896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.748182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.748877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.750827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.751636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 784/1572] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:22.752453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.763015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7421d-9e22-46a7-90ce-6ddba37b66d4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.767603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.768283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.768606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.768888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.769616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.771622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.867588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 789/1573] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.868498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.879861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c06af-774b-4759-beee-fe77a8f6233c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.884505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.885156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.885482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.885834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.886641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.888563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.901713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 785/1574] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:22.901713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:22.911676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b23b3-71ed-43de-8cea-beda583dfdf1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:22.916286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:22.917807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:22.918026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:22.918311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:22.919007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:22.920943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:22.999754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 790/1575] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.002002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.038386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:23.052021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 786/1576] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:22 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.052021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.069777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b066f9-0815-466c-9a0c-afecbb658586 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.116037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4537-30e5-410e-a36e-38590749bedb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.121876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.122547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.122864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.123158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.123859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.125891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.128805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.128941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.129511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.129828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.130751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.132313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.147017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 791/1577] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:23.147017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.155663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345448-7529-46c0-a702-9bc35fc0d1a9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.160264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.160852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.161204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.161546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.162234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.164131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.227767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 787/1578] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.228402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.241826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:23.257020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 792/1579] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.257020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.301779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815f50-f710-4ae4-8434-60c93209711d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.328822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd6fed-15b8-49ab-839a-4f6696e60cfb admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.334098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.334795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.335082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.335365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.336092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.337745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.351696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 793/1580] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:23.351696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.361384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b576a-df7d-45dd-9e24-ca9259bba604 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.364906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.366023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.366180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.366453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.366759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.367026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] PATH_INFO: `/v3/projects/9717aa832ae944abba7067f03d9753c1/users/91a2f3cfe6c9484e8e674824ec55759d/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.367209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.367369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.368044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.369693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.383552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 794/1581] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:23.383552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.383838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9717aa832ae944abba7067f03d9753c1, user_id=91a2f3cfe6c9484e8e674824ec55759d, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.386073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.391723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd525bb-6304-4f97-8464-8541b3e7958f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.396425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.400830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.400830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.400830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.400830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.400830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.502355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 788/1582] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:23 2022] PUT /identity/v3/projects/9717aa832ae944abba7067f03d9753c1/users/91a2f3cfe6c9484e8e674824ec55759d/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:23.503161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.531138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 795/1583] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.531965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.542925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74774-fcb7-40fb-8223-00301b048a6c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.562471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:23.567343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b262f6-c7ab-4513-a44c-8738e99b2893 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.571980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.576650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.576650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.576650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.576650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.577078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.604244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.605467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.605607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.605787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] PATH_INFO: `/v3/projects/85cd0d0402244286b9199e77f8ef18ca/users/a25a52e592a34cd48a8c88304501c047/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.619391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85cd0d0402244286b9199e77f8ef18ca, user_id=a25a52e592a34cd48a8c88304501c047, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.620565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:48:23.620565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:48:23.620565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:48:23.622640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.720241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 789/1584] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.721051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.730965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1a77-38fa-41af-b100-62b82bced147 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.735641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.736287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.736577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.736863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.737630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.739674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.753542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 796/1585] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:23 2022] PUT /identity/v3/projects/85cd0d0402244286b9199e77f8ef18ca/users/a25a52e592a34cd48a8c88304501c047/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:23.754349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.815033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f2ef-db23-41ec-afbb-aaef1be13578 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.819692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.820367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.820657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.820942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.821671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.824263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.834771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 790/1586] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.834771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.843770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadce159-3cca-41fd-8e13-b31074b123dd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.848667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.849423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.849719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.849995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.850727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.852369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.864413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 791/1587] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:23.865386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.871644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:23.875470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c983f1-6700-4f89-ad41-bbf3e1a5000d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.880240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954d98-4c10-442b-89e3-3b13d8b7cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.880912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954d98-4c10-442b-89e3-3b13d8b7cfba admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.881204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954d98-4c10-442b-89e3-3b13d8b7cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.881550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954d98-4c10-442b-89e3-3b13d8b7cfba admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.882266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954d98-4c10-442b-89e3-3b13d8b7cfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.883871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954d98-4c10-442b-89e3-3b13d8b7cfba admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:23.894883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 792/1588] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:23.896073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.896447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.896734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.922618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] MFA Rules not processed for user `91a2f3cfe6c9484e8e674824ec55759d`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:23.923794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:23.977571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 797/1589] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:23.977571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.985314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1f66-301d-450e-955f-77c01270c805 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:23.989032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 793/1590] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:23.989880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefab1c2-483d-4893-958d-a0da2e19aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:23.990134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:23.990700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefab1c2-483d-4893-958d-a0da2e19aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:23.990917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefab1c2-483d-4893-958d-a0da2e19aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:23.991200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefab1c2-483d-4893-958d-a0da2e19aa03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:23.991931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefab1c2-483d-4893-958d-a0da2e19aa03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:23.993959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefab1c2-483d-4893-958d-a0da2e19aa03 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.001140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfeaeb8-8266-4bc5-9da2-51c2844f6975 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.008586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 798/1591] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.008738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.008738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.008738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.008738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.009119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.009119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.009119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.009409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.009409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.022309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 794/1592] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.023410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.028336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:24.029733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:24.034155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0945d5-f9b5-4a61-97fd-56153512c850 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.037401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 799/1593] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:24.038163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.038908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.039583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.039875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.040159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.041528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.042772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.049170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392527e1-919b-4016-99c8-812ba5a53b6d None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.053700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.054241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 795/1594] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.054602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.054890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.055170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] PATH_INFO: `/v3/projects/d490ed437c3f4155afccbfaf03f0ecdf/users/5ca81e5671d3482b9be4968231f1386b/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.055724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.066200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d89c2-5123-4e70-984a-335920f656ac admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.071038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.071386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d490ed437c3f4155afccbfaf03f0ecdf, user_id=5ca81e5671d3482b9be4968231f1386b, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.071921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.072211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.072504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] PATH_INFO: `/v3/projects/c472023e58b3452ba90df954d22eea1d/users/05c5be0130464d44a568fbc51855e995/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.074470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.088547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c472023e58b3452ba90df954d22eea1d, user_id=05c5be0130464d44a568fbc51855e995, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.092003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.175649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 800/1595] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:24 2022] PUT /identity/v3/projects/d490ed437c3f4155afccbfaf03f0ecdf/users/5ca81e5671d3482b9be4968231f1386b/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:24.176482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.205375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 796/1596] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:24 2022] PUT /identity/v3/projects/c472023e58b3452ba90df954d22eea1d/users/05c5be0130464d44a568fbc51855e995/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:24.206304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.230848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:24.242682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a48c3-1d21-4d9d-92d4-ded1f71dfe0e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.278573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194ab6f-8036-4d9a-a8bc-57ad5a8826a6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.283500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.284167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.284454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.285176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.285914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.287873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.304493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.305162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.305537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.305826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.306559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.308975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.319050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 801/1597] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.319938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.330204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688b78f-092d-4cdd-bd51-0d852c89e4a1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.335599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.336242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.338052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.338052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.338052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.339264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.349297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 802/1598] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.350259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.360264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7a9d-e69e-408d-9304-307a6217e3a4 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.364821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.365480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.365771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.366054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.366765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.368329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.379361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 803/1599] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.380403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.382011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:24.405685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 797/1600] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:24.406542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.430700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:24.440937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52577e0a-0de1-4a5a-a884-c5cce2e8c677 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.473009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9890-76ab-4c41-9285-d4a12c858f5a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.478752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48f711-22fc-4461-8a8d-e9b4894687d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.480067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f711-22fc-4461-8a8d-e9b4894687d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.480314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f711-22fc-4461-8a8d-e9b4894687d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.480597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f711-22fc-4461-8a8d-e9b4894687d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.481430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48f711-22fc-4461-8a8d-e9b4894687d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.483046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48f711-22fc-4461-8a8d-e9b4894687d7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.490911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11795e-fa0d-4033-bb7f-b42397906d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.491560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11795e-fa0d-4033-bb7f-b42397906d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.491844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11795e-fa0d-4033-bb7f-b42397906d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.492126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11795e-fa0d-4033-bb7f-b42397906d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.493359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 798/1601] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.494599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71744-a119-4637-8a15-41799a97775a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.494893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71744-a119-4637-8a15-41799a97775a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.495810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71744-a119-4637-8a15-41799a97775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.505119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11795e-fa0d-4033-bb7f-b42397906d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.506658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11795e-fa0d-4033-bb7f-b42397906d07 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.516479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 804/1602] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:24.521444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.521444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.521444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.523561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-59b71744-a119-4637-8a15-41799a97775a None None] MFA Rules not processed for user `5ca81e5671d3482b9be4968231f1386b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:24.524782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-59b71744-a119-4637-8a15-41799a97775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:24.548492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] MFA Rules not processed for user `05c5be0130464d44a568fbc51855e995`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:24.549763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:24.569571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:24.596746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 799/1603] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:24.597617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71744-a119-4637-8a15-41799a97775a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.608511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71744-a119-4637-8a15-41799a97775a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.613041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.613773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.614063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.614453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.615187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.616801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.619099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 805/1604] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:24.619528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.630878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 800/1605] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:24.630878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.638579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fa76f-fb91-4d2a-98f4-396ee1e36caa None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.638579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.638579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.638579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.639445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] PATH_INFO: `/v3/projects/25beca9acf4f4420b1a2dc0ec397847e/users/f45384380b364e60823101515b359ba6/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.641415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f5fec-4690-43b5-bb7a-40b062ae1d35 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.646071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.646948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.647235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.647514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] PATH_INFO: `/v3/projects/0a35c2bcb0e44e0ab3751a83635424e8/users/52ad18360dc64d2ea85cc950c9daa723/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.653684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25beca9acf4f4420b1a2dc0ec397847e, user_id=f45384380b364e60823101515b359ba6, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.656364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.665444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a35c2bcb0e44e0ab3751a83635424e8, user_id=52ad18360dc64d2ea85cc950c9daa723, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.666395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.799714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 806/1606] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:24 2022] PUT /identity/v3/projects/25beca9acf4f4420b1a2dc0ec397847e/users/f45384380b364e60823101515b359ba6/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:24.800530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.833308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 801/1607] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:24 2022] PUT /identity/v3/projects/0a35c2bcb0e44e0ab3751a83635424e8/users/52ad18360dc64d2ea85cc950c9daa723/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:24.834195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:24.877031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04e502-a148-4952-b4f7-281431aa44d9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.926236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5866af-686f-40f6-9af8-479ab184f920 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:24.933531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.934456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.934746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.935027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] PATH_INFO: `/v3/projects/8d951c7f7afd49b09b6045b09a9d98e0/users/22950ef462df4f54a999200e183200c3/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.947406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:24.948337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:24.948677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:24.948963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:24.949745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.952004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.952459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d951c7f7afd49b09b6045b09a9d98e0, user_id=22950ef462df4f54a999200e183200c3, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:24.955412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:24.958440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:25.067093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 807/1608] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:24 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:25.070914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.071229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 802/1609] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:24 2022] PUT /identity/v3/projects/8d951c7f7afd49b09b6045b09a9d98e0/users/22950ef462df4f54a999200e183200c3/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:25.072327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.080980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1634630-2e1a-4312-b5e8-b0d4e1449b9c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.116398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:25.140388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2b663-6bb2-4cdf-bbc6-e8c3867d0476 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.148032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.148709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.148999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.149305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.150047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.150155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fbb47-d7d9-49ca-85fd-075765473fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.150931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fbb47-d7d9-49ca-85fd-075765473fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.151248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fbb47-d7d9-49ca-85fd-075765473fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.152086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fbb47-d7d9-49ca-85fd-075765473fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.152723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.153010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fbb47-d7d9-49ca-85fd-075765473fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.155334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fbb47-d7d9-49ca-85fd-075765473fb6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.264220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 808/1610] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:25.265482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.304227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 803/1611] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:25.305528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56d1a-d46c-4a9c-b033-9e2879995012 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.305816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56d1a-d46c-4a9c-b033-9e2879995012 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.306101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56d1a-d46c-4a9c-b033-9e2879995012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.328736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-61a56d1a-d46c-4a9c-b033-9e2879995012 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:25.328736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-61a56d1a-d46c-4a9c-b033-9e2879995012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:25.333025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffffe31-b2bc-4296-be79-2e460ff70c7f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.393145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 804/1612] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:25.394541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.394833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.395116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.410092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.411099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.411393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.411708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] PATH_INFO: `/v3/projects/f908215832834011b2b303260dc55467/users/0d8b144f25af475cbcefd18ecd69aa7e/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.415854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:25.417488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:25.425899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 805/1613] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:25.426838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.430854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f908215832834011b2b303260dc55467, user_id=0d8b144f25af475cbcefd18ecd69aa7e, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.433847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.438125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc341-a832-4e62-895d-35476bdc640c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.443899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67caf5-9d28-44cc-9d50-68fa2c7830e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.447636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67caf5-9d28-44cc-9d50-68fa2c7830e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.447636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67caf5-9d28-44cc-9d50-68fa2c7830e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.447636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67caf5-9d28-44cc-9d50-68fa2c7830e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.447636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67caf5-9d28-44cc-9d50-68fa2c7830e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.447636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67caf5-9d28-44cc-9d50-68fa2c7830e6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.459669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 806/1614] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:25.460690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.460987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.461343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.480288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:25.482074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:25.489154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 807/1615] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:25.489956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.500480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b2d9-947e-45c5-a54d-a7056480b029 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.505161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.514203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.514203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.514203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.514203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.514203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.547897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 809/1616] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:25 2022] PUT /identity/v3/projects/f908215832834011b2b303260dc55467/users/0d8b144f25af475cbcefd18ecd69aa7e/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:25.549386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.599290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:25.613036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27948fe2-3435-4542-9390-4b7007e524bc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.617966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.618645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.618935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.619218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.620462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.622448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.656052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 808/1617] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/users => generated 308 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:25.656052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.695276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:25.712609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2596f-b774-4fd3-80c0-c6fdc3017cfb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.762823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.763484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.763775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.764057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.770391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 810/1618] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:25.771332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.774364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.775876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.781515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749ee7-b438-4827-be63-91fd6d54429e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.785291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.785951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.786248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.786466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 809/1619] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:25.786574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.787275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.800430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.803855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.804397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82a4bf-9e5d-4f88-a971-eeabd20f5a10 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.811221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.812500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.812790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.813095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] PATH_INFO: `/v3/projects/4f4c2e99734643c7a12e305f650105b9/users/67887895f0cc4c7cb59241bcf5afac31/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.818767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 811/1620] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:25.819915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.831363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed091-dcf0-4866-9715-78c11ca8f3b5 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:25.832390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4c2e99734643c7a12e305f650105b9, user_id=67887895f0cc4c7cb59241bcf5afac31, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.835440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.837307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358767a5-4a0c-4d83-b17d-0d483b7444d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:25.838302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358767a5-4a0c-4d83-b17d-0d483b7444d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.839087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358767a5-4a0c-4d83-b17d-0d483b7444d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.839557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358767a5-4a0c-4d83-b17d-0d483b7444d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.851182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358767a5-4a0c-4d83-b17d-0d483b7444d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:25.852566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358767a5-4a0c-4d83-b17d-0d483b7444d3 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:25.863967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 812/1621] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:25.865222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:25.865542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:25.865825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:25.894831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] MFA Rules not processed for user `0d8b144f25af475cbcefd18ecd69aa7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:25.896093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:25.928484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 810/1622] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:25 2022] PUT /identity/v3/projects/4f4c2e99734643c7a12e305f650105b9/users/67887895f0cc4c7cb59241bcf5afac31/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:25.928484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:25.987601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 813/1623] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:25.987601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.000852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e174f2-d4df-4f5c-8470-1e59564072ba None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.008942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.011002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.012344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.012344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.012528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad19a6-08a8-4c8d-b0f5-b69ae118370f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.012620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.014333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.016884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9f36-471f-4803-8f9b-f9cf8e6ce731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.018060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9f36-471f-4803-8f9b-f9cf8e6ce731 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.018366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9f36-471f-4803-8f9b-f9cf8e6ce731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.018690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9f36-471f-4803-8f9b-f9cf8e6ce731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.019450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9f36-471f-4803-8f9b-f9cf8e6ce731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.021085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9f36-471f-4803-8f9b-f9cf8e6ce731 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.034177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 814/1624] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:26.034177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.038566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 811/1625] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:26.038566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876753f1-3f07-45ff-bb34-cba71faa505f None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.041676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876753f1-3f07-45ff-bb34-cba71faa505f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.043766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876753f1-3f07-45ff-bb34-cba71faa505f None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.047520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 812/1626] 10.222.0.70 () {54 vars in 961 bytes} [Tue Jun 21 16:48:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:26.048437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876753f1-3f07-45ff-bb34-cba71faa505f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.050618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb07a0-58c3-46db-b2a4-92f3499760bc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.059468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.060723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.061778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.062237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.063321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.065475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.067226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876753f1-3f07-45ff-bb34-cba71faa505f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.072219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf83fd8-481f-4e60-8fed-d264052bd68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.073500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf83fd8-481f-4e60-8fed-d264052bd68e admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.075292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf83fd8-481f-4e60-8fed-d264052bd68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.075426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf83fd8-481f-4e60-8fed-d264052bd68e admin admin] PATH_INFO: `/v3/projects/619b8721b5b1455387323b9cc260f714/users/9fcfbdfb494e4883a6f598a7205f0dcf/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.084227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 815/1627] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:26.085459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.102335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578a15c-e877-4c5d-a7b1-da2b41571271 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.102624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf83fd8-481f-4e60-8fed-d264052bd68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=619b8721b5b1455387323b9cc260f714, user_id=9fcfbdfb494e4883a6f598a7205f0dcf, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.106696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf83fd8-481f-4e60-8fed-d264052bd68e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.109769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.111266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.111818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.112303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] PATH_INFO: `/v3/projects/1e1ee18a1825483c92be9035a427c5b0/users/16f81a67ee024817ba5a9c2bc74e7441/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.141804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1ee18a1825483c92be9035a427c5b0, user_id=16f81a67ee024817ba5a9c2bc74e7441, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.147927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.253573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 813/1628] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:26 2022] PUT /identity/v3/projects/619b8721b5b1455387323b9cc260f714/users/9fcfbdfb494e4883a6f598a7205f0dcf/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:26.257697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11362834-1797-45ba-930d-68cac38afc22 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.257697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11362834-1797-45ba-930d-68cac38afc22 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.257697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11362834-1797-45ba-930d-68cac38afc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.279723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 816/1629] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:26 2022] PUT /identity/v3/projects/1e1ee18a1825483c92be9035a427c5b0/users/16f81a67ee024817ba5a9c2bc74e7441/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:26.280973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.303489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-11362834-1797-45ba-930d-68cac38afc22 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:26.304664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-11362834-1797-45ba-930d-68cac38afc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:26.363181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:26.421531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:26.422582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 814/1630] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Jun 21 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:26.424036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11362834-1797-45ba-930d-68cac38afc22 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.440530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2bc32-81d3-47da-8dce-bd008c249666 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.441190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11362834-1797-45ba-930d-68cac38afc22 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.447960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.449880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.450539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.450979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.452359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.454114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.454248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.455156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.455443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.455725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] PATH_INFO: `/v3/projects/4f4c2e99734643c7a12e305f650105b9/users/67887895f0cc4c7cb59241bcf5afac31/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.459894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4c2e99734643c7a12e305f650105b9, user_id=67887895f0cc4c7cb59241bcf5afac31, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.468417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.470803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 815/1631] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:26.471975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.485690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 817/1632] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:26 2022] PUT /identity/v3/projects/4f4c2e99734643c7a12e305f650105b9/users/67887895f0cc4c7cb59241bcf5afac31/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:26.499506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59ed71-ea09-436c-a135-188003dd5e75 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.499640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.579981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.581087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.581087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.581374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.582245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.584310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.599956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 816/1633] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:26.601045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.602657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45046b0-acab-402f-97d4-970b4ccb8c4d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.609492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.610214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.610508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.610791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.612643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7a85-2156-4301-afe9-20c63e77c264 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.619143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc34bef-2dce-422a-a12d-469b14df54a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.620256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc34bef-2dce-422a-a12d-469b14df54a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.620548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc34bef-2dce-422a-a12d-469b14df54a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.620839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc34bef-2dce-422a-a12d-469b14df54a4 admin admin] PATH_INFO: `/v3/projects/619b8721b5b1455387323b9cc260f714/users/9fcfbdfb494e4883a6f598a7205f0dcf/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.622981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc34bef-2dce-422a-a12d-469b14df54a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619b8721b5b1455387323b9cc260f714, user_id=9fcfbdfb494e4883a6f598a7205f0dcf, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.641648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc34bef-2dce-422a-a12d-469b14df54a4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.671085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 817/1634] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:26 2022] PUT /identity/v3/projects/619b8721b5b1455387323b9cc260f714/users/9fcfbdfb494e4883a6f598a7205f0dcf/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:26.684364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f57b3-eba9-462b-b29b-24d69d83ff9b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.687009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f57b3-eba9-462b-b29b-24d69d83ff9b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.687186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f57b3-eba9-462b-b29b-24d69d83ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.691739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.695064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.710208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 818/1635] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:26.710560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:26.724441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02a9d-d15c-4286-bf3b-e71bc786ca28 service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:26.747380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1c8f57b3-eba9-462b-b29b-24d69d83ff9b None None] MFA Rules not processed for user `67887895f0cc4c7cb59241bcf5afac31`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:26.748737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1c8f57b3-eba9-462b-b29b-24d69d83ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:26.793600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c964c4-5bc0-417f-9ef3-2c14e28f0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:26.795702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c964c4-5bc0-417f-9ef3-2c14e28f0aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.795702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c964c4-5bc0-417f-9ef3-2c14e28f0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.796055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c964c4-5bc0-417f-9ef3-2c14e28f0aa8 admin admin] PATH_INFO: `/v3/projects/1e1ee18a1825483c92be9035a427c5b0/users/16f81a67ee024817ba5a9c2bc74e7441/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.798422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c964c4-5bc0-417f-9ef3-2c14e28f0aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1ee18a1825483c92be9035a427c5b0, user_id=16f81a67ee024817ba5a9c2bc74e7441, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:26.802360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c964c4-5bc0-417f-9ef3-2c14e28f0aa8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:26.816030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 819/1636] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:26 2022] PUT /identity/v3/projects/1e1ee18a1825483c92be9035a427c5b0/users/16f81a67ee024817ba5a9c2bc74e7441/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:26.818358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.818866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.821855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.861592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 818/1637] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:26.863127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:26.863367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:26.863653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:26.885967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] MFA Rules not processed for user `9fcfbdfb494e4883a6f598a7205f0dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:26.890532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:26.914939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] MFA Rules not processed for user `16f81a67ee024817ba5a9c2bc74e7441`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:26.916868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:27.089354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 820/1638] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:27.090451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:27.148390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 819/1639] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:27.149838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:27.162469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1ab4e-fbec-40f8-b61f-a4cc72cd2eba None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:27.168112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:27.168790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:27.169082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:27.169924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:27.173892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858c61-05f8-4f82-a6c0-43ed170b0069 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:27.187744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30b565-c4b8-482d-8866-043ef90e30a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:27.188913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b565-c4b8-482d-8866-043ef90e30a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:27.189382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b565-c4b8-482d-8866-043ef90e30a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:27.189772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b565-c4b8-482d-8866-043ef90e30a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:27.211752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b565-c4b8-482d-8866-043ef90e30a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:27.214088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b565-c4b8-482d-8866-043ef90e30a3 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:27.235310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 820/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:27.236904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ffa2c-d219-48c9-be56-c137d02b9346 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:27.250276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:27.251089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ffa2c-d219-48c9-be56-c137d02b9346 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:27.251772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ffa2c-d219-48c9-be56-c137d02b9346 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:27.254045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 821/1641] 10.222.0.70 () {54 vars in 912 bytes} [Tue Jun 21 16:48:27 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:27.271006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:27.271308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:27.271600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:27.301868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:27.303230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:27.320672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:27.323776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:27.338155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 821/1642] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:27.346107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:27.399458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:27.408863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f09dc-1b44-4bf0-b62b-bfb0366c95db service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:27.423860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 822/1643] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:27.435741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:27.443526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:27.445553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:27.452539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:27.467930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:27.469445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:27.483565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 822/1644] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:48:27.633002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:27.645002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790fe3-ebd8-402d-b696-5109ec73253a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:27.649684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:27.650418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:27.650755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:27.651740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:27.669970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:27.671805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:27.698942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 823/1645] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:28.004130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:28.015224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0e3ea-eda9-4b02-82e2-5a64d9166d41 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:28.021221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93507d4-16cb-4834-902d-778080e7cc06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:28.022296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93507d4-16cb-4834-902d-778080e7cc06 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:28.022789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93507d4-16cb-4834-902d-778080e7cc06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:28.023272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93507d4-16cb-4834-902d-778080e7cc06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:28.103395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93507d4-16cb-4834-902d-778080e7cc06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:28.106143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93507d4-16cb-4834-902d-778080e7cc06 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:28.117390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 823/1646] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:28.798674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:29.420583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:29.587286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04167e-cdd2-409e-a3bd-baee7947a0d6 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:29.612474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:29.613451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:29.613787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:29.614042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] PATH_INFO: `/v3/users/5ca81e5671d3482b9be4968231f1386b` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:29.616187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca81e5671d3482b9be4968231f1386b)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:29.618159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:29.752570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:29.872641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2206a2-6ad0-48bd-a5ae-83ce2d559d44 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:29.873227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2206a2-6ad0-48bd-a5ae-83ce2d559d44 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:29.873393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2206a2-6ad0-48bd-a5ae-83ce2d559d44 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:29.875603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 824/1647] 10.222.0.70 () {54 vars in 961 bytes} [Tue Jun 21 16:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:29.883399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb109-2cfa-4b02-9fb0-2ca646bff80d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:29.883700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb109-2cfa-4b02-9fb0-2ca646bff80d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:29.883989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb109-2cfa-4b02-9fb0-2ca646bff80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:29.921553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f33cb109-2cfa-4b02-9fb0-2ca646bff80d None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:29.923579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f33cb109-2cfa-4b02-9fb0-2ca646bff80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:29.923717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca81e5671d3482b9be4968231f1386b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:29.946832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca81e5671d3482b9be4968231f1386b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:29.947388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 825/1648] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Jun 21 16:48:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:48:29.949460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca81e5671d3482b9be4968231f1386b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:29.950746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca81e5671d3482b9be4968231f1386b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:29.955127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d66287-500f-428d-bd3d-e767171b3316 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:29.955600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d66287-500f-428d-bd3d-e767171b3316 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:29.956126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d66287-500f-428d-bd3d-e767171b3316 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:29.958897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 826/1649] 10.222.0.70 () {54 vars in 912 bytes} [Tue Jun 21 16:48:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:29.965980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:29.966773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:29.967310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:29.987624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca81e5671d3482b9be4968231f1386b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:29.991371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:29.993798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:30.008301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 827/1650] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:48:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:48:30.024067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:30.027479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:30.041709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3bcd0-abc7-4838-b569-98a6c97601ba None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:30.048640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cdf22-4515-46c3-bd13-f51eb137572d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:30.050001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cdf22-4515-46c3-bd13-f51eb137572d service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:30.050601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cdf22-4515-46c3-bd13-f51eb137572d service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:30.051200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cdf22-4515-46c3-bd13-f51eb137572d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:30.072159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cdf22-4515-46c3-bd13-f51eb137572d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:30.075813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cdf22-4515-46c3-bd13-f51eb137572d service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:30.108751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 828/1651] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:48:30.198431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 824/1652] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:29 2022] DELETE /identity/v3/users/5ca81e5671d3482b9be4968231f1386b => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:30.202985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:30.203280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:30.203566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:30.226252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:30.227496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:30.313459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 829/1653] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:30.359269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:30.361622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:30.439959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74ae7f-9369-465f-b487-1ddc5c6183c9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:30.446076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d918f7-92b8-442b-a353-f30bf6671df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:30.447040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918f7-92b8-442b-a353-f30bf6671df1 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:30.447525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918f7-92b8-442b-a353-f30bf6671df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:30.448683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d918f7-92b8-442b-a353-f30bf6671df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:30.473319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d918f7-92b8-442b-a353-f30bf6671df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:30.476089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d918f7-92b8-442b-a353-f30bf6671df1 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:30.495973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 825/1654] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:30.519234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:30.526632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:30.552690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19124456-9f2e-4b41-818d-8103159b2be4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:30.568707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:30.570173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:30.570580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:30.571484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] PATH_INFO: `/v3/users/91a2f3cfe6c9484e8e674824ec55759d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:30.574482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a2f3cfe6c9484e8e674824ec55759d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:30.579855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: WARNING py.warnings [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:48:30.579855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: warnings.warn(msg) Jun 21 16:48:30.579855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: Jun 21 16:48:30.583196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:31.002706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a2f3cfe6c9484e8e674824ec55759d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:31.034105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a2f3cfe6c9484e8e674824ec55759d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:31.034827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a2f3cfe6c9484e8e674824ec55759d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:31.035576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a2f3cfe6c9484e8e674824ec55759d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:31.169718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a2f3cfe6c9484e8e674824ec55759d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:31.282070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 830/1655] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:30 2022] DELETE /identity/v3/users/91a2f3cfe6c9484e8e674824ec55759d => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:31.286792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:31.287090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:31.287381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:31.321886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:31.326431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:31.461053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 826/1656] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:31.488182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:31.489953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:31.559907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:31.637207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71dabd-b371-486a-91bd-2b35d486942e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:31.647625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:31.658554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:31.658962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:31.659259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:31.684419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:31.685994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:31.709070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 831/1657] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:32.054888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:32.056454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:32.076908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78b9d4-3b83-4432-9c22-5a472eb01a90 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:32.112338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:32.117637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:32.118161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:32.118267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] PATH_INFO: `/v3/projects/d490ed437c3f4155afccbfaf03f0ecdf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:32.119769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d490ed437c3f4155afccbfaf03f0ecdf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:32.122011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: WARNING py.warnings [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:48:32.122011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: warnings.warn(msg) Jun 21 16:48:32.122011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: Jun 21 16:48:32.125188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:32.334278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:32.357905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd490ed437c3f4155afccbfaf03f0ecdf', 'request_id': 'req-2f708bfc-9465-4414-a99c-13d209c54c6b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:32.366337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd490ed437c3f4155afccbfaf03f0ecdf', 'request_id': 'req-2f708bfc-9465-4414-a99c-13d209c54c6b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:32.386767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd490ed437c3f4155afccbfaf03f0ecdf', 'request_id': 'req-2f708bfc-9465-4414-a99c-13d209c54c6b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:32.524270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] The token cache is being invalidate because project d490ed437c3f4155afccbfaf03f0ecdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:32.524908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:32.525548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:32.531926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 827/1658] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:32 2022] DELETE /identity/v3/projects/d490ed437c3f4155afccbfaf03f0ecdf => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:32.537392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:32.561909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26b128-bea6-4939-ae84-a1d4e064ad00 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:32.740049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:32.741872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:32.742395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:32.743055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] PATH_INFO: `/v3/users/16f81a67ee024817ba5a9c2bc74e7441` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:32.745454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f81a67ee024817ba5a9c2bc74e7441)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:32.749027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:33.027631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f81a67ee024817ba5a9c2bc74e7441'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:33.063074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f81a67ee024817ba5a9c2bc74e7441'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:33.063074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f81a67ee024817ba5a9c2bc74e7441'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:33.063074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f81a67ee024817ba5a9c2bc74e7441'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:33.145090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c38287c-6659-434e-8d03-9b405bbfe099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f81a67ee024817ba5a9c2bc74e7441'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:33.190786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 832/1659] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:32 2022] DELETE /identity/v3/users/16f81a67ee024817ba5a9c2bc74e7441 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:33.435810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:33.436996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:33.469044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f708bfc-9465-4414-a99c-13d209c54c6b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:33.646459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:33.648405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:33.649517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:33.649875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] PATH_INFO: `/v3/users/0d8b144f25af475cbcefd18ecd69aa7e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:33.654304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8b144f25af475cbcefd18ecd69aa7e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:33.661350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:34.138746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8b144f25af475cbcefd18ecd69aa7e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:34.150179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8b144f25af475cbcefd18ecd69aa7e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:34.152892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8b144f25af475cbcefd18ecd69aa7e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:34.153926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8b144f25af475cbcefd18ecd69aa7e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:34.193794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8b144f25af475cbcefd18ecd69aa7e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:34.403772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 828/1660] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:33 2022] DELETE /identity/v3/users/0d8b144f25af475cbcefd18ecd69aa7e => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:34.408596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:34.409123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:34.409351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:34.442638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:34.446099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:34.583340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:34.628824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 833/1661] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:34.764960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:34.768055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:34.820598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ac3e0-8af6-4668-863a-22d2aa8086a5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:34.870896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:34.876861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:34.885887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:34.887184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:34.890454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:34.893767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] PATH_INFO: `/v3/projects/9717aa832ae944abba7067f03d9753c1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:34.899270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9717aa832ae944abba7067f03d9753c1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:34.909212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:35.032392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fe468-103e-4fd4-a939-4b66844f1ecc None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:35.039545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:35.039545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:35.039545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:35.039545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:35.064304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:35.065827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:35.091101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 834/1662] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:48:35.151305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:35.166842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9717aa832ae944abba7067f03d9753c1', 'request_id': 'req-b81123de-1c45-4e46-b4f3-9cd7301b29a8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.186822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9717aa832ae944abba7067f03d9753c1', 'request_id': 'req-b81123de-1c45-4e46-b4f3-9cd7301b29a8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.204030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9717aa832ae944abba7067f03d9753c1', 'request_id': 'req-b81123de-1c45-4e46-b4f3-9cd7301b29a8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.330078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] The token cache is being invalidate because project 9717aa832ae944abba7067f03d9753c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:35.332360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.332360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.336285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 829/1663] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:34 2022] DELETE /identity/v3/projects/9717aa832ae944abba7067f03d9753c1 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:35.340350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:35.368238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786a25b-afdf-438d-99b4-569a30f4abc3 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:35.524053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:35.526424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:35.527059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:35.527550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] PATH_INFO: `/v3/users/67887895f0cc4c7cb59241bcf5afac31` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:35.536752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67887895f0cc4c7cb59241bcf5afac31)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:35.536752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:35.796618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67887895f0cc4c7cb59241bcf5afac31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.818528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67887895f0cc4c7cb59241bcf5afac31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.819154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67887895f0cc4c7cb59241bcf5afac31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.819785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67887895f0cc4c7cb59241bcf5afac31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.946515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67887895f0cc4c7cb59241bcf5afac31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:35.999498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 835/1664] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:35 2022] DELETE /identity/v3/users/67887895f0cc4c7cb59241bcf5afac31 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:36.114203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:36.115542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:36.130395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81123de-1c45-4e46-b4f3-9cd7301b29a8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:36.165478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:36.167504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:36.230953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:36.232378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.232849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.234142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] PATH_INFO: `/v3/projects/f908215832834011b2b303260dc55467` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.235721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f908215832834011b2b303260dc55467)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:36.237995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:36.321219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012be8-39c1-4dc7-aa72-b36f231f3538 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:36.337726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:36.339920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.340611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.341863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] PATH_INFO: `/v3/projects/1e1ee18a1825483c92be9035a427c5b0` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.345860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1ee18a1825483c92be9035a427c5b0)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:36.349671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:36.405367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f908215832834011b2b303260dc55467', 'request_id': 'req-f4a95146-b58d-4f48-ae3c-0571547e2d2b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.423524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f908215832834011b2b303260dc55467', 'request_id': 'req-f4a95146-b58d-4f48-ae3c-0571547e2d2b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.438048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f908215832834011b2b303260dc55467', 'request_id': 'req-f4a95146-b58d-4f48-ae3c-0571547e2d2b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.516035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1ee18a1825483c92be9035a427c5b0', 'request_id': 'req-742dc125-abe4-44ed-9303-4568ec6eefba'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.534534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] The token cache is being invalidate because project f908215832834011b2b303260dc55467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:36.534824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.535680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f4a95146-b58d-4f48-ae3c-0571547e2d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.537426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 830/1665] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:36 2022] DELETE /identity/v3/projects/f908215832834011b2b303260dc55467 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:36.545900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e0d7-da47-4219-8c1d-5c9bbf002dd5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.546190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e0d7-da47-4219-8c1d-5c9bbf002dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.546477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e0d7-da47-4219-8c1d-5c9bbf002dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.568913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7169e0d7-da47-4219-8c1d-5c9bbf002dd5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:36.570520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7169e0d7-da47-4219-8c1d-5c9bbf002dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:36.621038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1ee18a1825483c92be9035a427c5b0', 'request_id': 'req-742dc125-abe4-44ed-9303-4568ec6eefba'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.629754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1ee18a1825483c92be9035a427c5b0', 'request_id': 'req-742dc125-abe4-44ed-9303-4568ec6eefba'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.658361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] The token cache is being invalidate because project 1e1ee18a1825483c92be9035a427c5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:36.660168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.663982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-742dc125-abe4-44ed-9303-4568ec6eefba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:36.667730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 836/1666] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:36 2022] DELETE /identity/v3/projects/1e1ee18a1825483c92be9035a427c5b0 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:48:36.672841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ac2f-1d1b-4af0-ab27-80b72e6225fa None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.673356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ac2f-1d1b-4af0-ab27-80b72e6225fa None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.673786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ac2f-1d1b-4af0-ab27-80b72e6225fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.689580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 831/1667] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:36.694412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.694910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.695391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.724005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6333ac2f-1d1b-4af0-ab27-80b72e6225fa None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:36.725939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6333ac2f-1d1b-4af0-ab27-80b72e6225fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:36.746987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:36.751604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 837/1668] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:36.752249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:36.758627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.758964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.759254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.787035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 832/1669] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:48:36.792261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:36.816428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a453-6907-4ef7-99e6-5e8def5afadc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:36.819908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:36.824726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:36.831186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:36.832043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.832336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.832619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.853010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:36.853010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:36.853010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:36.855665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 838/1670] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:36.859596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:36.883113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868adc-88ef-46ee-a393-e5a654fa6287 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:36.889538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 833/1671] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:36.896521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:36.902962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:36.903753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.904045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.904332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.905086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:36.911345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:36.916390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:36.924923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd052-2863-4e20-9a9b-cbd71ddc4006 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:36.949801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 839/1672] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:48:36.954353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:36.960131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:36.960821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:36.961115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:36.961428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:36.962833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:36.967771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:36.988273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c1ade-415b-43f4-9a5c-2bed9fa37f62 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.006297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.007546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.007689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.007978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.008698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.015570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.021806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:37.194674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 840/1673] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:36 2022] POST /identity/v3/projects => generated 405 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:48:37.200030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.209724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 834/1674] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:36 2022] POST /identity/v3/projects => generated 373 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:37.211687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.359053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc396f-716e-4928-81db-3afdf5f13296 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.372352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a130ba-73e7-43ee-9d40-5731edbf184c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.381711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.382609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.382995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.383375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.384247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.403361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.454658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.455356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.455649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.456980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.457974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.462054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.575401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 835/1675] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:37 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:37.579420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.580704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:37.615813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 841/1676] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:37 2022] POST /identity/v3/users => generated 303 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:37.618296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.620365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f00cfb-021e-409a-b1db-b86fc6d2ac59 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.642688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.643588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.643877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.646476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafb5d0-b470-42bc-b508-8e2e11a1e780 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.647658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] PATH_INFO: `/v3/projects/4f4c2e99734643c7a12e305f650105b9` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.651208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4c2e99734643c7a12e305f650105b9)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.653428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.658410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.659275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.659660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.660085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.661045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.662974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.683637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 842/1677] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:37.684889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.719034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be799ad-74ea-45fa-bf79-272339315ca6 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.730085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:37.732365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.733305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.738703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.738703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.738703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.740674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.766147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 843/1678] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:37.768076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.783632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11456b-1d7a-414d-9aee-697cf05ae19a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.794119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:37.800050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:37.800606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:37.802220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:37.803040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:37.809813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:37.838141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 844/1679] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:37.840039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.865608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4c2e99734643c7a12e305f650105b9', 'request_id': 'req-de26ada1-ecef-4405-9ab0-01615109b8b2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:37.880074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4c2e99734643c7a12e305f650105b9', 'request_id': 'req-de26ada1-ecef-4405-9ab0-01615109b8b2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:37.883725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82c29-c127-490b-a90e-ad3e4592dcb7 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:37.901687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4c2e99734643c7a12e305f650105b9', 'request_id': 'req-de26ada1-ecef-4405-9ab0-01615109b8b2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:37.973127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] The token cache is being invalidate because project 4f4c2e99734643c7a12e305f650105b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:37.973598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:37.974363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:37.976418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 836/1680] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:37 2022] DELETE /identity/v3/projects/4f4c2e99734643c7a12e305f650105b9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:37.977923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:37.981455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.023830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aee02a-8263-4e25-9e0e-9a4179f775fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:38.028124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee02a-8263-4e25-9e0e-9a4179f775fe admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.028124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee02a-8263-4e25-9e0e-9a4179f775fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.028124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee02a-8263-4e25-9e0e-9a4179f775fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.028124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aee02a-8263-4e25-9e0e-9a4179f775fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:38.031518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aee02a-8263-4e25-9e0e-9a4179f775fe admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:38.067190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 845/1681] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:38.086570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.087347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.090232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.138726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:38.141947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.165749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ada1-ecef-4405-9ab0-01615109b8b2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:38.173464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834013d6-e94c-4e35-ad3e-a0fc01978c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:38.175761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834013d6-e94c-4e35-ad3e-a0fc01978c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.176251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834013d6-e94c-4e35-ad3e-a0fc01978c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.176685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834013d6-e94c-4e35-ad3e-a0fc01978c7e admin admin] PATH_INFO: `/v3/projects/9336a6bf654246f88de45d31e0a509bb/users/9f99b5e9482642939f8b9edec6c89ddc/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.178194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 846/1682] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:38.179287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:38.185946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.210819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3cc4f-aec5-41de-a8c3-17736aaf12b7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:38.214497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834013d6-e94c-4e35-ad3e-a0fc01978c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9336a6bf654246f88de45d31e0a509bb, user_id=9f99b5e9482642939f8b9edec6c89ddc, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:38.217426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834013d6-e94c-4e35-ad3e-a0fc01978c7e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:38.225081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15cb9-c81d-4774-a89c-238190cf3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:38.226234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15cb9-c81d-4774-a89c-238190cf3f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.226557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15cb9-c81d-4774-a89c-238190cf3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.226909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15cb9-c81d-4774-a89c-238190cf3f6c admin admin] PATH_INFO: `/v3/projects/bc59c5e4ff4140229946f6a92abf78b9/users/4f80a83e6ab7412694b431930f9d951c/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.252904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d15cb9-c81d-4774-a89c-238190cf3f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc59c5e4ff4140229946f6a92abf78b9, user_id=4f80a83e6ab7412694b431930f9d951c, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:38.257667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d15cb9-c81d-4774-a89c-238190cf3f6c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:38.394954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 837/1683] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:37 2022] PUT /identity/v3/projects/9336a6bf654246f88de45d31e0a509bb/users/9f99b5e9482642939f8b9edec6c89ddc/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:38.396723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 847/1684] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:38 2022] PUT /identity/v3/projects/bc59c5e4ff4140229946f6a92abf78b9/users/4f80a83e6ab7412694b431930f9d951c/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:38.399301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbce55-8ca3-4fff-b4c9-271546646776 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.400263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbce55-8ca3-4fff-b4c9-271546646776 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.404487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbce55-8ca3-4fff-b4c9-271546646776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.404895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.405731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.406779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.470516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-dcdbce55-8ca3-4fff-b4c9-271546646776 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:38.475946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:38.477112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.483104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-dcdbce55-8ca3-4fff-b4c9-271546646776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.666882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 838/1685] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:38.669695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.671684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.672999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.673181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 848/1686] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:38.676452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:38.717497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761084cc-f70e-4525-9c27-4e3fb460c4e3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:38.738435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:38.742257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.743584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.745683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.746727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:38.748939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:38.751811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:38.773820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] MFA Rules not processed for user `9f99b5e9482642939f8b9edec6c89ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:38.778158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.789116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 849/1687] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:38.791060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:38.793494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:38.947254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 839/1688] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:38.947254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:38.965629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f786-81a3-454b-998a-ff99a6821b46 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:38.972838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd7fd1-eac3-4552-8dca-521c6e17401a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:38.986305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:38.986535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:38.987034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.987330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.987614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.988062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:38.988324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:38.988633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:38.989047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:38.993233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.002129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.003855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.034591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 850/1689] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:39.035816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.048109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35db0-528b-477c-a28b-3f7dbd8110e0 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.053614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.055564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.056198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.056719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.058866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.064368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.131753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 840/1690] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:38 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:39.137013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.167372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:39.177797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 851/1691] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:39 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:39.183783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.304977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b58362-c6ca-43d5-9d28-41bdc8ee0ee3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.437995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93a09d-1101-48f5-8819-6694961cd77d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.444806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.448366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.448366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.448366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.450083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.453539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.481598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.482310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.482610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.482897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.483614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.487802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.539946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:39.565142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 852/1692] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:39 2022] POST /identity/v3/users => generated 292 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:39.567285 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.616175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5902cf-ba93-4e05-85a9-fef3b3f2e95a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.644196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 841/1693] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:39 2022] POST /identity/v3/users => generated 290 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:39.645313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.652122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.652122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.652867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.652867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.653624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.655264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.667389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a4b1-36b9-4262-b58d-abc6dfdd5299 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.681399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 853/1694] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:39.685962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.687306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.688010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.688318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.690522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.691300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.696645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.722187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539aaf-39d5-43bc-8c12-6a7df0a861a2 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.729839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e1012-a8ed-48d2-bced-28a36c3e2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.731551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1012-a8ed-48d2-bced-28a36c3e2ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.731979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1012-a8ed-48d2-bced-28a36c3e2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.732399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1012-a8ed-48d2-bced-28a36c3e2ffb admin admin] PATH_INFO: `/v3/projects/f3487df9b0f242b6a407c1a72ffde71e/users/3367331a3c6a47cdaa2530e36aa6593e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.736066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 842/1695] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:39.737223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.773370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938a77-ca6d-4a3d-ba43-736f479b4dba admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.782462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e1012-a8ed-48d2-bced-28a36c3e2ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3487df9b0f242b6a407c1a72ffde71e, user_id=3367331a3c6a47cdaa2530e36aa6593e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.785386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e1012-a8ed-48d2-bced-28a36c3e2ffb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.787976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.788654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.788951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.789235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.790011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:39.796867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:39.834223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 843/1696] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:39.838309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:39.877415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 854/1697] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:39 2022] PUT /identity/v3/projects/f3487df9b0f242b6a407c1a72ffde71e/users/3367331a3c6a47cdaa2530e36aa6593e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:39.877415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.877415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.877415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:39.877763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d04571-87ab-442e-8354-d91ab01d8e0c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:39.935635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] MFA Rules not processed for user `f45384380b364e60823101515b359ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:39.936903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:39.983340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbc005-04c2-41fe-89a2-cf0816cfcbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:39.985490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbc005-04c2-41fe-89a2-cf0816cfcbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:39.985784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbc005-04c2-41fe-89a2-cf0816cfcbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:39.986112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbc005-04c2-41fe-89a2-cf0816cfcbc5 admin admin] PATH_INFO: `/v3/projects/e4de69a294b14925a3a015621e0bf8ed/users/a416e2d5b93d4284a2e57d1b23a7eb2f/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.070489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbc005-04c2-41fe-89a2-cf0816cfcbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4de69a294b14925a3a015621e0bf8ed, user_id=a416e2d5b93d4284a2e57d1b23a7eb2f, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:40.078457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbc005-04c2-41fe-89a2-cf0816cfcbc5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:40.127798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 855/1698] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:40.129179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:40.147205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd222d2-fb5c-4fda-bf17-f7f254fd6cd4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:40.153810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03125e-aca6-44f6-8375-99beecaf9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:40.154661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03125e-aca6-44f6-8375-99beecaf9998 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.155061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03125e-aca6-44f6-8375-99beecaf9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.155420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03125e-aca6-44f6-8375-99beecaf9998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.156664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03125e-aca6-44f6-8375-99beecaf9998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:40.158088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03125e-aca6-44f6-8375-99beecaf9998 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:40.174630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 856/1699] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:40.174630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.174630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.174630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.226063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 844/1700] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:39 2022] PUT /identity/v3/projects/e4de69a294b14925a3a015621e0bf8ed/users/a416e2d5b93d4284a2e57d1b23a7eb2f/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:48:40.233961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] MFA Rules not processed for user `a25a52e592a34cd48a8c88304501c047`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:40.235211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:40.243449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3c01c-7433-4490-b5c5-3d9dc065a2d2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.243967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3c01c-7433-4490-b5c5-3d9dc065a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.244422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3c01c-7433-4490-b5c5-3d9dc065a2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.320903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a6e3c01c-7433-4490-b5c5-3d9dc065a2d2 None None] MFA Rules not processed for user `f45384380b364e60823101515b359ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:40.322270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a6e3c01c-7433-4490-b5c5-3d9dc065a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:40.390388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 857/1701] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:40.393089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:40.501988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 845/1702] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:40.503375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.505606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.516604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.553698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769d04-406f-4a9e-b9a7-e88a00f83f1b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:40.563649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:40.564972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.565475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.566275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] PATH_INFO: `/v3/projects/f3487df9b0f242b6a407c1a72ffde71e/users/3367331a3c6a47cdaa2530e36aa6593e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.568791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3487df9b0f242b6a407c1a72ffde71e, user_id=3367331a3c6a47cdaa2530e36aa6593e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:40.571520 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:40.587149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 858/1703] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:40 2022] PUT /identity/v3/projects/f3487df9b0f242b6a407c1a72ffde71e/users/3367331a3c6a47cdaa2530e36aa6593e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:40.589095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:40.599224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] MFA Rules not processed for user `a416e2d5b93d4284a2e57d1b23a7eb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:40.599477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:40.600843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:40.746778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 846/1704] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:40.748275 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:40.754079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:40.771986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de64d9-55ed-4af8-ae14-21d3c999e87c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:40.786322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625efd61-7247-439b-ac29-b570db92fdd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:40.789418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625efd61-7247-439b-ac29-b570db92fdd2 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.789418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625efd61-7247-439b-ac29-b570db92fdd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.789418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625efd61-7247-439b-ac29-b570db92fdd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.790684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3dedf-b2e4-4a1c-9c57-fc10ecf69707 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:40.803339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672f83d-1bff-4d5c-80aa-b4a417ef8b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:40.804420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f83d-1bff-4d5c-80aa-b4a417ef8b2f service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.804944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f83d-1bff-4d5c-80aa-b4a417ef8b2f service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.805608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f83d-1bff-4d5c-80aa-b4a417ef8b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.927930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625efd61-7247-439b-ac29-b570db92fdd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:40.929616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625efd61-7247-439b-ac29-b570db92fdd2 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:40.965412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 859/1705] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:40.966726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672f83d-1bff-4d5c-80aa-b4a417ef8b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:40.966940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.968655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672f83d-1bff-4d5c-80aa-b4a417ef8b2f service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:40.972744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.973086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:40.993112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 847/1706] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:40.994687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:40.994931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:40.995168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:41.055551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] MFA Rules not processed for user `52ad18360dc64d2ea85cc950c9daa723`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:41.058599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:41.062416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] MFA Rules not processed for user `3367331a3c6a47cdaa2530e36aa6593e`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:41.065683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:41.247145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 860/1707] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:41.248704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:41.296960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 848/1708] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:41.317035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:41.320168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:41.420493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2745e32-78ad-4441-b6aa-75f3c6b16859 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:41.433894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:41.433894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:41.433894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:41.433894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:41.434302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:41.439445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:41.444003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:41.475412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfa05b-e28a-4a6c-b5cf-e79c1a1243bd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:41.481914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:41.483932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:41.485602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:41.485900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:41.504141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:41.505970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:41.531824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 849/1709] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:41.532850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:41.590993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06278c76-0378-47de-84c5-c25288314e27 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:41.599699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:41.599699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:41.600022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:41.600358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:41.619660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 861/1710] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:41 2022] POST /identity/v3/projects => generated 377 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:41.625068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:41.625912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:41.629627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:41.695802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 850/1711] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:41.831339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2239c-c2c1-432e-9c33-ceb6df078783 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:41.834220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:41.863516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd006-2f22-4cb9-bb42-7e5ff1ae17e9 service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:41.889508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:41.889508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:41.889508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:41.889508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:41.907339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:41.918083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:41.970382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:42.079394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad9972-5321-4f11-9e39-6686ce43d6bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:42.080229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9972-5321-4f11-9e39-6686ce43d6bd service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.080567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9972-5321-4f11-9e39-6686ce43d6bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.080856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9972-5321-4f11-9e39-6686ce43d6bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.128520 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 862/1712] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:41 2022] POST /identity/v3/users => generated 289 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:48:42.132558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:42.151156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4a0b0-7c37-441e-84ef-d2a8e71eec53 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:42.156755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:42.160296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.160710 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.161098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.162175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:42.164062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:42.191395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 863/1713] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:42.192832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:42.230090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d963bd-ef39-4433-b014-fc44502ac653 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:42.234646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad9972-5321-4f11-9e39-6686ce43d6bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:42.244844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:42.246738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.248004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad9972-5321-4f11-9e39-6686ce43d6bd service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:42.248539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.248990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.249964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:42.254572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:42.292325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 864/1714] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:42.297352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:42.322632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b6109-fd26-450f-98d2-ced8f5a1067a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:42.331398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 851/1715] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:48:42.349088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77feda9-d810-4020-bec7-8e70a894b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:42.350168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77feda9-d810-4020-bec7-8e70a894b92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.350458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77feda9-d810-4020-bec7-8e70a894b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.350738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77feda9-d810-4020-bec7-8e70a894b92e admin admin] PATH_INFO: `/v3/projects/ee1b7fefb4b54f10a3f3066a31f98ff0/users/5d1d110084054b3fa07eb5d76a863d67/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.382738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29fc3-4d13-4fec-8e51-a3ca9243d612 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.385628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29fc3-4d13-4fec-8e51-a3ca9243d612 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.386388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29fc3-4d13-4fec-8e51-a3ca9243d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.428363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77feda9-d810-4020-bec7-8e70a894b92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1b7fefb4b54f10a3f3066a31f98ff0, user_id=5d1d110084054b3fa07eb5d76a863d67, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:42.431255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77feda9-d810-4020-bec7-8e70a894b92e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:42.482100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-82c29fc3-4d13-4fec-8e51-a3ca9243d612 None None] MFA Rules not processed for user `22950ef462df4f54a999200e183200c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:42.488193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-82c29fc3-4d13-4fec-8e51-a3ca9243d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:42.643157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 852/1716] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:42.643157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c36eb-67da-4dff-b6b4-ddb3820e6b0a None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.643157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c36eb-67da-4dff-b6b4-ddb3820e6b0a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.643157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c36eb-67da-4dff-b6b4-ddb3820e6b0a None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.643157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 853/1717] 10.222.0.70 () {54 vars in 912 bytes} [Tue Jun 21 16:48:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:42.644059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5eca-da9c-4cbd-8e81-b5d3e2369b77 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.644350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5eca-da9c-4cbd-8e81-b5d3e2369b77 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.644638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5eca-da9c-4cbd-8e81-b5d3e2369b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.710832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-53bb5eca-da9c-4cbd-8e81-b5d3e2369b77 None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:42.711855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-53bb5eca-da9c-4cbd-8e81-b5d3e2369b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:42.727809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 865/1718] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:42 2022] PUT /identity/v3/projects/ee1b7fefb4b54f10a3f3066a31f98ff0/users/5d1d110084054b3fa07eb5d76a863d67/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:42.727809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ebbb6-6441-49fa-817f-3f5009cf8ac0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.727809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ebbb6-6441-49fa-817f-3f5009cf8ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.727809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ebbb6-6441-49fa-817f-3f5009cf8ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.791498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-533ebbb6-6441-49fa-817f-3f5009cf8ac0 None None] MFA Rules not processed for user `22950ef462df4f54a999200e183200c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:42.794167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-533ebbb6-6441-49fa-817f-3f5009cf8ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:42.826374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 854/1719] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:42.828691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:42.831869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:42.832195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:42.898777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] MFA Rules not processed for user `4f80a83e6ab7412694b431930f9d951c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:42.903925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:43.034886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 866/1720] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:43.037096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:43.037861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:43.038338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:43.095845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] MFA Rules not processed for user `5d1d110084054b3fa07eb5d76a863d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:43.100054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:43.136975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 855/1721] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:43.139069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:43.174931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f13e-77a9-46a7-ad72-df4a177156ea None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:43.181922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:43.183548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:43.183548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:43.195241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:43.228866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:43.231643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:43.252506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 856/1722] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:43.254941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:43.300006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 867/1723] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:43.300647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:43.484453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:43.488929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a3bed-5146-419e-98e9-a9cf05358e68 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:43.498089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:43.498871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:43.499161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:43.499917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:43.513193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:43.515188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:43.515824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456bfca-c724-4067-83ef-b90037f2d96e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:43.547253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:43.548601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:43.549093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:43.549310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 857/1724] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:43.552503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:43.557317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:43.572365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:43.574981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:43.605627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55421bd-ccfd-4a99-a1e4-882430abb1bd service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:43.622400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:43.623146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:43.623498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:43.623792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:43.624819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:43.627918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:43.705990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 868/1725] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:43 2022] POST /identity/v3/projects => generated 405 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:43.710225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:43.764467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 858/1726] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:43 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:43.768980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:43.907088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cb08-2dc5-42a4-ba68-d2786d0b6145 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:43.938004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dffeb0-4a82-46d9-8747-9541d7f9a839 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:43.945341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:43.946140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:43.950429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:43.950429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:43.950429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:43.951697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.037678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.038996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.039547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.039935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.040917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.046109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.099713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 859/1727] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:43 2022] POST /identity/v3/users => generated 296 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:44.106771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.133481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4b63-c614-44f1-9d62-626fbafa3b1a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.150488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.151654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.153418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.153788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.154852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.173070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.195813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 860/1728] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:44.198255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.208519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 869/1729] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:43 2022] POST /identity/v3/users => generated 309 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:48:44.216514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.244030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9c8c-c60d-407b-92e0-9abb96f79542 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.252740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.253750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.254037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.254373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] PATH_INFO: `/v3/projects/f05a5702fee44a8c8d7e7aaae87139a9/users/af7ce671d6994e02be37d9b4fc7efbb5/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.258241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfe76e-7652-4aa1-b166-06910f071d8f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.281570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.282316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.282601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.282881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.283165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05a5702fee44a8c8d7e7aaae87139a9, user_id=af7ce671d6994e02be37d9b4fc7efbb5, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.283725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.285546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.287771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.295975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:44.327587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 870/1730] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:44.327587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.348638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b164eeb-ec58-43a1-851f-0886599c61f4 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.366582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.367884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.368963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.370085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] PATH_INFO: `/v3/projects/f0c90c35ee3e44c78e94a3e654b9a467/users/989ce32d981540fc8cbf0ae977fe4210/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.409699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 861/1731] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:44 2022] PUT /identity/v3/projects/f05a5702fee44a8c8d7e7aaae87139a9/users/af7ce671d6994e02be37d9b4fc7efbb5/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:44.411707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.457804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c90c35ee3e44c78e94a3e654b9a467, user_id=989ce32d981540fc8cbf0ae977fe4210, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.469143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.551676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e4ca-ce21-4cc1-9fcc-0d4fcad68c74 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.558900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.560299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.561067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.561553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.562801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.566179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.581237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 862/1732] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:44.586281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.614125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 871/1733] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:44 2022] PUT /identity/v3/projects/f0c90c35ee3e44c78e94a3e654b9a467/users/989ce32d981540fc8cbf0ae977fe4210/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:44.616036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab8614-a371-4a5e-a7cd-41af886ba941 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.619020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.777534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d0741-5174-4968-b6d0-351a5993ca54 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.781043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b94ee9-06d9-4aaa-8298-c1221cd022b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.781043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b94ee9-06d9-4aaa-8298-c1221cd022b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.781043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b94ee9-06d9-4aaa-8298-c1221cd022b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.781043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b94ee9-06d9-4aaa-8298-c1221cd022b1 admin admin] PATH_INFO: `/v3/projects/f05a5702fee44a8c8d7e7aaae87139a9/users/af7ce671d6994e02be37d9b4fc7efbb5/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.782033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b94ee9-06d9-4aaa-8298-c1221cd022b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05a5702fee44a8c8d7e7aaae87139a9, user_id=af7ce671d6994e02be37d9b4fc7efbb5, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.783350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.784101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.784397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.784684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.785598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.786024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b94ee9-06d9-4aaa-8298-c1221cd022b1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.789112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:44.802715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 872/1734] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:44.804278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.806329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:44.828357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 863/1735] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:44 2022] PUT /identity/v3/projects/f05a5702fee44a8c8d7e7aaae87139a9/users/af7ce671d6994e02be37d9b4fc7efbb5/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:44.828357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca901-c9b0-47ac-ae7c-d0bc7369030c None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.828357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca901-c9b0-47ac-ae7c-d0bc7369030c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.828357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca901-c9b0-47ac-ae7c-d0bc7369030c None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.828357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 864/1736] 10.222.0.70 () {54 vars in 912 bytes} [Tue Jun 21 16:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:44.828357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca901-c9b0-47ac-ae7c-d0bc7369030c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:44.835578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8ce6-ef57-4170-bb79-8d6c4a81d332 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.983664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca901-c9b0-47ac-ae7c-d0bc7369030c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:44.989587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512463-24b7-4465-8c93-22a4f0d5fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:44.990564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512463-24b7-4465-8c93-22a4f0d5fccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:44.990860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512463-24b7-4465-8c93-22a4f0d5fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:44.991140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512463-24b7-4465-8c93-22a4f0d5fccb admin admin] PATH_INFO: `/v3/projects/f0c90c35ee3e44c78e94a3e654b9a467/users/989ce32d981540fc8cbf0ae977fe4210/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:44.993322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512463-24b7-4465-8c93-22a4f0d5fccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c90c35ee3e44c78e94a3e654b9a467, user_id=989ce32d981540fc8cbf0ae977fe4210, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:44.996502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512463-24b7-4465-8c93-22a4f0d5fccb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:45.001930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:45.007751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.007751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.007751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] PATH_INFO: `/v3/users/05c5be0130464d44a568fbc51855e995` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.007751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c5be0130464d44a568fbc51855e995)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:45.011175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:45.042075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 865/1737] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:44 2022] PUT /identity/v3/projects/f0c90c35ee3e44c78e94a3e654b9a467/users/989ce32d981540fc8cbf0ae977fe4210/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:45.044234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8086c-717b-47a9-a84d-0c30f7813aa7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.044534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8086c-717b-47a9-a84d-0c30f7813aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.044820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8086c-717b-47a9-a84d-0c30f7813aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.069169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0ae8086c-717b-47a9-a84d-0c30f7813aa7 None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:45.070715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0ae8086c-717b-47a9-a84d-0c30f7813aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.186834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 866/1738] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:45.188537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c391d-77b9-4d02-922d-e5679065184c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.188832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c391d-77b9-4d02-922d-e5679065184c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.189118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c391d-77b9-4d02-922d-e5679065184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.238644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a28c391d-77b9-4d02-922d-e5679065184c None None] MFA Rules not processed for user `af7ce671d6994e02be37d9b4fc7efbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:45.241821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a28c391d-77b9-4d02-922d-e5679065184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.246138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c5be0130464d44a568fbc51855e995'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:45.256277 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c5be0130464d44a568fbc51855e995'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:45.257631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c5be0130464d44a568fbc51855e995'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:45.269683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c5be0130464d44a568fbc51855e995'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:45.378476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c5be0130464d44a568fbc51855e995'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:45.378602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 867/1739] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:45.380272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c6a7-1529-4d87-acf8-0b666fb84810 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.380574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c6a7-1529-4d87-acf8-0b666fb84810 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.380859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c6a7-1529-4d87-acf8-0b666fb84810 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.391374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 868/1740] 10.222.0.70 () {54 vars in 960 bytes} [Tue Jun 21 16:48:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:45.391374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac890c-5727-47a6-968e-9765954a9ed7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.391374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac890c-5727-47a6-968e-9765954a9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.391374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac890c-5727-47a6-968e-9765954a9ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.393965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:45.417642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6cac890c-5727-47a6-968e-9765954a9ed7 None None] MFA Rules not processed for user `f45384380b364e60823101515b359ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:45.419185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6cac890c-5727-47a6-968e-9765954a9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.435288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 873/1741] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:44 2022] DELETE /identity/v3/users/05c5be0130464d44a568fbc51855e995 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:45.435288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:45.435288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.626588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 869/1742] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:45.626588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bfbec-74d0-4313-b415-03348d606d9b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.626588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bfbec-74d0-4313-b415-03348d606d9b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.626588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bfbec-74d0-4313-b415-03348d606d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.630790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31310a0-1454-4220-9eab-17f9fab8626b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:45.639487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:45.640211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.640503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.640785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.648282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.675049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-196bfbec-74d0-4313-b415-03348d606d9b None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:45.677036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-196bfbec-74d0-4313-b415-03348d606d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.684654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:45.688018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:45.719380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 874/1743] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:45.720512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:45.725374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.818931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 870/1744] 10.222.0.70 () {58 vars in 1057 bytes} [Tue Jun 21 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:45.820452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.820782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.821057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:45.850807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:45.852202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:45.867837 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097520b-6d61-438c-8e6f-629fa0c3e99a service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:45.873823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:45.874637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:45.875049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:45.875583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:46.002894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 871/1745] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:46.004350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:46.007332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:46.008998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:46.033363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 875/1746] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:46.041814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dfbed-42ec-4a7b-8e38-33a131e32c8b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:46.042286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:46.046528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:46.056143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:46.061682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:46.061682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:46.061682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:46.068592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:46.073804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b86c0-25a0-4108-98d1-5200171835b2 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:46.082658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:46.083693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:46.084164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:46.084483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:46.093196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:46.096993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:46.109535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:46.111556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:46.128437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 872/1747] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:46.149745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 876/1748] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:46.160538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:46.201496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:46.215660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:46.230955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d575c3-0de8-40e0-bbe6-be92edc5a114 service placement] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:46.247432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:46.248983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:46.249236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:46.249555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:46.256492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:46.418150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:46.423761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:46.472823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 873/1749] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:47.328539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:47.572505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:47.679153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:47.680865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:47.712791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da539bf3-b30a-4d69-a74c-d61112c38e33 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:47.712791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:47.714405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:47.714966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:47.716056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] PATH_INFO: `/v3/projects/c472023e58b3452ba90df954d22eea1d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:47.717732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c472023e58b3452ba90df954d22eea1d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:47.720270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:47.881480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c472023e58b3452ba90df954d22eea1d', 'request_id': 'req-ede40037-fd0e-4cfe-9e27-d4277afa0a46'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:47.988659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c472023e58b3452ba90df954d22eea1d', 'request_id': 'req-ede40037-fd0e-4cfe-9e27-d4277afa0a46'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:47.995360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c472023e58b3452ba90df954d22eea1d', 'request_id': 'req-ede40037-fd0e-4cfe-9e27-d4277afa0a46'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.019651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] The token cache is being invalidate because project c472023e58b3452ba90df954d22eea1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:48.019949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.025805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ede40037-fd0e-4cfe-9e27-d4277afa0a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.028069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 877/1750] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:47 2022] DELETE /identity/v3/projects/c472023e58b3452ba90df954d22eea1d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:48.031978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:48.053184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe141-a38a-4248-944e-4e905d67a9f3 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:48.275970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:48.277165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:48.277692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:48.278125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] PATH_INFO: `/v3/users/9fcfbdfb494e4883a6f598a7205f0dcf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:48.280206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcfbdfb494e4883a6f598a7205f0dcf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:48.282410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:48.627714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:48.695053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5263e5-e127-4d22-aad9-fc778aef1dac None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:48.695556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5263e5-e127-4d22-aad9-fc778aef1dac None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:48.695645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5263e5-e127-4d22-aad9-fc778aef1dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:48.749222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-7f5263e5-e127-4d22-aad9-fc778aef1dac None None] MFA Rules not processed for user `a25a52e592a34cd48a8c88304501c047`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:48.752287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7f5263e5-e127-4d22-aad9-fc778aef1dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:48.911665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 878/1751] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:48.916992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcfbdfb494e4883a6f598a7205f0dcf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.941649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:48.941649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:48.941932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:48.980268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcfbdfb494e4883a6f598a7205f0dcf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.980770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] MFA Rules not processed for user `989ce32d981540fc8cbf0ae977fe4210`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:48.981865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcfbdfb494e4883a6f598a7205f0dcf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.982773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcfbdfb494e4883a6f598a7205f0dcf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:48.984334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:49.040155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fe69b7b7-9cd6-44c6-8f66-9cda213b39e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcfbdfb494e4883a6f598a7205f0dcf'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:49.183733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 874/1752] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:48 2022] DELETE /identity/v3/users/9fcfbdfb494e4883a6f598a7205f0dcf => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:49.218739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 879/1753] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:49.971687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:50.092497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:50.399338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c7ea-04b7-4c29-8cdd-5f7c3bedea90 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:50.399623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c7ea-04b7-4c29-8cdd-5f7c3bedea90 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:50.400211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c7ea-04b7-4c29-8cdd-5f7c3bedea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:50.479248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-56d1c7ea-04b7-4c29-8cdd-5f7c3bedea90 None None] MFA Rules not processed for user `52ad18360dc64d2ea85cc950c9daa723`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:50.485656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-56d1c7ea-04b7-4c29-8cdd-5f7c3bedea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:50.620213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 875/1754] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:50.743787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:50.746474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:50.818955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce21e0-428f-4443-ae55-b2a68665a0e2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:50.949608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:50.968674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:50.983974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:50.985427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] PATH_INFO: `/v3/projects/619b8721b5b1455387323b9cc260f714` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:50.993943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=619b8721b5b1455387323b9cc260f714)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:50.997898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:51.250036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619b8721b5b1455387323b9cc260f714', 'request_id': 'req-179578f9-7e07-4e17-840c-3cf995a9be2d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:51.406579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619b8721b5b1455387323b9cc260f714', 'request_id': 'req-179578f9-7e07-4e17-840c-3cf995a9be2d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:51.416833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619b8721b5b1455387323b9cc260f714', 'request_id': 'req-179578f9-7e07-4e17-840c-3cf995a9be2d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:51.484644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] The token cache is being invalidate because project 619b8721b5b1455387323b9cc260f714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:51.484644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:51.484644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-179578f9-7e07-4e17-840c-3cf995a9be2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:51.493813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:51.494321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:51.494429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:51.502744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 880/1755] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:50 2022] DELETE /identity/v3/projects/619b8721b5b1455387323b9cc260f714 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:51.592197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:51.597670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:51.814108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:51.814410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:51.814703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:51.818657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 876/1756] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:51.841493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:51.844878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:51.860537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:51.879965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 881/1757] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:51.880734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1553408-c83c-4e62-a5c3-af07ceedf44b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:51.886867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:51.888356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:51.889001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:51.889506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:51.890665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:48:51.891136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:51.895365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:51.916091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 877/1758] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:48:51.925082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:51.938016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceb2d0-44c5-419b-96bc-b6bf7582e5c2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:51.946424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c6cc-e33a-4f1a-8200-940a7932dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:51.953233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c6cc-e33a-4f1a-8200-940a7932dad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:51.953233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c6cc-e33a-4f1a-8200-940a7932dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:51.953233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c6cc-e33a-4f1a-8200-940a7932dad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:51.953233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c6cc-e33a-4f1a-8200-940a7932dad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:51.953233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c6cc-e33a-4f1a-8200-940a7932dad8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:52.110512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 882/1759] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:51 2022] POST /identity/v3/projects => generated 355 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:52.114338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:52.131090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ba3e-7df8-4353-9d57-1bee225d01bb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:52.193974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d69e7a-3fa7-4b0d-b561-574eb244ebb6 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.194497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d69e7a-3fa7-4b0d-b561-574eb244ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.194961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d69e7a-3fa7-4b0d-b561-574eb244ebb6 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.197114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 883/1760] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:48:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:48:52.260632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:52.264941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.265441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.266734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.279995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:52.280855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.282360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.282675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.284589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:52.287238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:52.319346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:52.323961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:52.446542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 878/1761] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:52 2022] POST /identity/v3/users => generated 278 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:52.462218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:52.465215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 884/1762] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:52.493847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:52.501122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07c24-ed30-419b-9e44-217a57b3e5a4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:52.509554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:52.522071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:52.524181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.524582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.526663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.535324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:52.538724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:52.552028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213829-23e4-41d1-86b0-6b15df579a45 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:52.569349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 879/1763] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:52.570657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:52.570865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162cc1-01dc-4d69-b567-e06619ea1dd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:52.571549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162cc1-01dc-4d69-b567-e06619ea1dd3 service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.571984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162cc1-01dc-4d69-b567-e06619ea1dd3 service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.572264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162cc1-01dc-4d69-b567-e06619ea1dd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.597897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e629a-8395-4c69-b869-093520696f88 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:52.600352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44162cc1-01dc-4d69-b567-e06619ea1dd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:52.602515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44162cc1-01dc-4d69-b567-e06619ea1dd3 service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:52.610149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:52.613042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.613500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.615074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.616008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:52.620429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:52.626933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:52.652641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 880/1764] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:52.654504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 885/1765] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:52.657150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:52.695731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c14dc-d828-479e-a7d9-59a827d92b3a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:52.709139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:52.710765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.712003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.713641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] PATH_INFO: `/v3/projects/548464a663c7402ba862fd0d6b24c138/users/bc4ae722077e434080b1e1f3306dfa80/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.766494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548464a663c7402ba862fd0d6b24c138, user_id=bc4ae722077e434080b1e1f3306dfa80, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:52.775509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:52.867692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 881/1766] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:52 2022] PUT /identity/v3/projects/548464a663c7402ba862fd0d6b24c138/users/bc4ae722077e434080b1e1f3306dfa80/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:52.879140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:52.879504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:52.879950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:52.946703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] MFA Rules not processed for user `bc4ae722077e434080b1e1f3306dfa80`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:52.947988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:53.090539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 886/1767] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:53.098132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:53.274059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755fa76-ec47-4729-827c-35cd9ad17ec5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:53.282679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:53.284374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:53.297646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:53.299011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:53.301886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:53.308702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:53.456284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 882/1768] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:48:53 2022] POST /identity/v3/projects => generated 357 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:53.468967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:53.487931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1b4c-bf66-40e7-81fa-a77af6ad0526 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:53.765773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:53.766487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:53.766774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:53.767113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:53.767830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:53.785679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:53.908390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 887/1769] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:48:53 2022] POST /identity/v3/users => generated 285 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:48:53.913197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:53.948927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33649-dba1-4bb8-ba58-15ea2eaeefe4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:53.983807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:53.983807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:53.983807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:53.983807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:53.996314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:54.010323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:54.068809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:54.092450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 883/1770] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:54.094089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b5df7-5adc-4d6d-af58-70abf5242cc7 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:54.106009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e9a2-8750-474f-90f5-7837df31624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:54.107376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e9a2-8750-474f-90f5-7837df31624a admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:54.109979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e9a2-8750-474f-90f5-7837df31624a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:54.111971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e9a2-8750-474f-90f5-7837df31624a admin admin] PATH_INFO: `/v3/projects/d0856453e74d4a37a961ca4b512d8bee/users/587dc236bebf4314b7c0f39b74f8162f/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:54.157818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:54.164785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e9a2-8750-474f-90f5-7837df31624a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0856453e74d4a37a961ca4b512d8bee, user_id=587dc236bebf4314b7c0f39b74f8162f, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:54.165800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e9a2-8750-474f-90f5-7837df31624a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:54.312441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 888/1771] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:54 2022] PUT /identity/v3/projects/d0856453e74d4a37a961ca4b512d8bee/users/587dc236bebf4314b7c0f39b74f8162f/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:54.316559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:54.342081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3910-25b3-45ca-82af-8729be15b423 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:54.519528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:54.520006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:54.520199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:54.536724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:54.575497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:54.576795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:54.599637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:54.600346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:54.600642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:54.608464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:54.610435 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:54.613237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:54.643901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 884/1772] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:48:54.644945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:54.647043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:54.684703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8920a1-3cce-4daf-b997-178b87241718 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:54.691289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:54.694305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:54.694305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:54.694305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] PATH_INFO: `/v3/users/a416e2d5b93d4284a2e57d1b23a7eb2f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:54.694723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a416e2d5b93d4284a2e57d1b23a7eb2f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:54.696760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:54.769451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 889/1773] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:54.772405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:54.797159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b770-b275-4096-a4d0-e20c446ad68a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:54.804219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b7cd8-28e6-4ff4-ae42-b46a501b20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:54.816390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b7cd8-28e6-4ff4-ae42-b46a501b20d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:54.816390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b7cd8-28e6-4ff4-ae42-b46a501b20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:54.816390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b7cd8-28e6-4ff4-ae42-b46a501b20d7 admin admin] PATH_INFO: `/v3/projects/d0856453e74d4a37a961ca4b512d8bee/users/587dc236bebf4314b7c0f39b74f8162f/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:54.816390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b7cd8-28e6-4ff4-ae42-b46a501b20d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0856453e74d4a37a961ca4b512d8bee, user_id=587dc236bebf4314b7c0f39b74f8162f, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:54.816390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b7cd8-28e6-4ff4-ae42-b46a501b20d7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:54.833360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 890/1774] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:48:54 2022] PUT /identity/v3/projects/d0856453e74d4a37a961ca4b512d8bee/users/587dc236bebf4314b7c0f39b74f8162f/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:54.840126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:54.843301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:54.843752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:54.907791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] MFA Rules not processed for user `587dc236bebf4314b7c0f39b74f8162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:54.923752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:54.934631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a416e2d5b93d4284a2e57d1b23a7eb2f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:54.965861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a416e2d5b93d4284a2e57d1b23a7eb2f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:54.968647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a416e2d5b93d4284a2e57d1b23a7eb2f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:54.970218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a416e2d5b93d4284a2e57d1b23a7eb2f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:55.019925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-96cb6509-8392-476d-ac12-27d3bbb40557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a416e2d5b93d4284a2e57d1b23a7eb2f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:55.067805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 891/1775] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:55.077082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:55.078918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:55.117142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:55.119994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 885/1776] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:54 2022] DELETE /identity/v3/users/a416e2d5b93d4284a2e57d1b23a7eb2f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:55.125034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:55.125485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:55.125920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:55.158122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:55.161099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:55.207962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bff2-5db2-4fa6-9101-93f198565966 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:55.308949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 886/1777] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:48:55.311112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:55.315673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:55.348475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:55.350597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:55.350736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:55.350940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:55.442496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d6cf-6c5e-433c-ad3c-f965f487e6f1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:55.462644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:55.463428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:55.463723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:55.464010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:55.469264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:55.496326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:55.498549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:55.511707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 892/1778] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:55 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:48:55.513061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:55.515082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:55.585943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:55.587591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee948a4-b793-49a4-909e-84cf78ad75da service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:55.633893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 887/1779] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:48:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:48:55.633893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89155-f9e6-42b2-86c7-99a2706f6192 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:55.633893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89155-f9e6-42b2-86c7-99a2706f6192 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:55.633893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89155-f9e6-42b2-86c7-99a2706f6192 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:55.633893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 888/1780] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:48:55.663926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8cd1f-a85b-4d05-99c5-175105cdee46 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:55.678443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:55.679333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:55.679699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:55.686622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:55.708228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:55.708518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:55.708805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:55.735852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:55.744808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:55.790573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] MFA Rules not processed for user `e5976deb8abc4c04b60380fa27703c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:55.792541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:55.815731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 893/1781] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:55.941030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:55.957354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:56.027931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9093b1-7292-4d01-b5d9-d37bfd34a69b service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:56.062013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:56.063002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:56.063361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:56.063574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] PATH_INFO: `/v3/users/4f80a83e6ab7412694b431930f9d951c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:56.078807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f80a83e6ab7412694b431930f9d951c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:56.080308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 889/1782] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:56.081336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:56.085596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:56.093076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f0a6-c3d9-433b-820a-9ec22c908d1a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:56.100939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:56.101771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:56.102214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:56.102552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:56.105204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:56.370719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:56.379204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:56.411549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 890/1783] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:56.439039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:56.440768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:56.491048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d253c-7f9d-4a59-a19f-7942ff4dd021 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:56.519472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da140b3-766d-4f84-b9d9-cd42494653ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:56.520171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da140b3-766d-4f84-b9d9-cd42494653ba service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:56.520463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da140b3-766d-4f84-b9d9-cd42494653ba service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:56.520752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da140b3-766d-4f84-b9d9-cd42494653ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:56.557747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da140b3-766d-4f84-b9d9-cd42494653ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:56.559590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da140b3-766d-4f84-b9d9-cd42494653ba service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:56.573800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f80a83e6ab7412694b431930f9d951c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:56.590276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f80a83e6ab7412694b431930f9d951c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:56.591333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f80a83e6ab7412694b431930f9d951c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:56.593175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f80a83e6ab7412694b431930f9d951c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:56.620633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 891/1784] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:56.734312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f80a83e6ab7412694b431930f9d951c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:56.760139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 894/1785] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:55 2022] DELETE /identity/v3/users/4f80a83e6ab7412694b431930f9d951c => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:56.829542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:57.266370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:57.929866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:57.930168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:57.930458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:57.965407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:57.967388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:57.969922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:48:57.973695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:58.140489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b700a-6a73-4fc7-a0ba-a695e64352fd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:58.155817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:58.156733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:58.157022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:58.157460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] PATH_INFO: `/v3/projects/e4de69a294b14925a3a015621e0bf8ed` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:58.159067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4de69a294b14925a3a015621e0bf8ed)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:58.164379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:58.181806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 892/1786] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Jun 21 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:48:58.254721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:58.257320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:58.285372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd523-9fca-4515-a4c4-a80915d5f651 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:58.293949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:58.294850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:58.295808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:58.296310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:58.322694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:58.324194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:58.372200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4de69a294b14925a3a015621e0bf8ed', 'request_id': 'req-71f3f47a-6052-462f-ace2-a694acc684cc'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:58.386549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 893/1787] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:48:58.386549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:58.406372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bd30-7677-4303-adff-acc568583c4b service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:58.470202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4de69a294b14925a3a015621e0bf8ed', 'request_id': 'req-71f3f47a-6052-462f-ace2-a694acc684cc'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:58.485592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4de69a294b14925a3a015621e0bf8ed', 'request_id': 'req-71f3f47a-6052-462f-ace2-a694acc684cc'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:58.540979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] The token cache is being invalidate because project e4de69a294b14925a3a015621e0bf8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:58.541302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:58.546419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:58.552212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 895/1788] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:57 2022] DELETE /identity/v3/projects/e4de69a294b14925a3a015621e0bf8ed => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:48:58.553095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:58.554046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:58.555755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:58.556788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:58.557368 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:58.560509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:58.564021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:58.584991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:58.587701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:58.602208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 894/1789] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:48:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:48:58.603436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:58.605653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:58.716809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081f5a9-f52f-4677-b737-3d2c282ed43f service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:58.734271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:58.738145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:58.738584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:58.738936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] PATH_INFO: `/v3/users/5d1d110084054b3fa07eb5d76a863d67` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:58.742422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1d110084054b3fa07eb5d76a863d67)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:58.744550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:58.794780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f47a-6052-462f-ace2-a694acc684cc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:58.807918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:58.809218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:58.809985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:58.812013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] PATH_INFO: `/v3/projects/bc59c5e4ff4140229946f6a92abf78b9` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:58.814843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc59c5e4ff4140229946f6a92abf78b9)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:58.818461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:59.110955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc59c5e4ff4140229946f6a92abf78b9', 'request_id': 'req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.130858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1d110084054b3fa07eb5d76a863d67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.147352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1d110084054b3fa07eb5d76a863d67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.148494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1d110084054b3fa07eb5d76a863d67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.149791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1d110084054b3fa07eb5d76a863d67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.172961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1d110084054b3fa07eb5d76a863d67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.220240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc59c5e4ff4140229946f6a92abf78b9', 'request_id': 'req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.229086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc59c5e4ff4140229946f6a92abf78b9', 'request_id': 'req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.277885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] The token cache is being invalidate because project bc59c5e4ff4140229946f6a92abf78b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:48:59.278188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.278905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.284165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 896/1790] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:48:58 2022] DELETE /identity/v3/projects/bc59c5e4ff4140229946f6a92abf78b9 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:59.285183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:48:59.286693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:48:59.336845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 895/1791] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:58 2022] DELETE /identity/v3/users/5d1d110084054b3fa07eb5d76a863d67 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:48:59.479958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bdde8-62dc-41c0-8f76-3b13168bdfc5 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:48:59.602035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:48:59.604950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:48:59.605858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:48:59.606660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] PATH_INFO: `/v3/users/989ce32d981540fc8cbf0ae977fe4210` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:48:59.610493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989ce32d981540fc8cbf0ae977fe4210)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:48:59.616202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:48:59.952258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989ce32d981540fc8cbf0ae977fe4210'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.974491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989ce32d981540fc8cbf0ae977fe4210'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.975304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989ce32d981540fc8cbf0ae977fe4210'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:48:59.977859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989ce32d981540fc8cbf0ae977fe4210'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:00.082226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989ce32d981540fc8cbf0ae977fe4210'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:00.143336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 897/1792] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:48:59 2022] DELETE /identity/v3/users/989ce32d981540fc8cbf0ae977fe4210 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:00.560657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:00.817185 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:00.819626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:00.856771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e57a5-80ed-4e6e-bd30-fcc4b87e1f0e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:01.092733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:01.093869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:01.094165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:01.094452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] PATH_INFO: `/v3/projects/ee1b7fefb4b54f10a3f3066a31f98ff0` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:01.096729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1b7fefb4b54f10a3f3066a31f98ff0)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:01.098736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:01.244971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:01.391179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1b7fefb4b54f10a3f3066a31f98ff0', 'request_id': 'req-2d20b89b-fba1-4699-a638-05fa17c1a9a3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:01.428925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1b7fefb4b54f10a3f3066a31f98ff0', 'request_id': 'req-2d20b89b-fba1-4699-a638-05fa17c1a9a3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:01.456740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1b7fefb4b54f10a3f3066a31f98ff0', 'request_id': 'req-2d20b89b-fba1-4699-a638-05fa17c1a9a3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:01.761814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] The token cache is being invalidate because project ee1b7fefb4b54f10a3f3066a31f98ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:01.761814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:01.761814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:01.763659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 896/1793] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:00 2022] DELETE /identity/v3/projects/ee1b7fefb4b54f10a3f3066a31f98ff0 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:01.767917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:01.769543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:01.792795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4418150-2602-40ff-9905-cf1d11175e31 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:01.926211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:01.927805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:01.928185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:01.928563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] PATH_INFO: `/v3/users/af7ce671d6994e02be37d9b4fc7efbb5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:01.932848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7ce671d6994e02be37d9b4fc7efbb5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:01.938537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:02.034965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:02.037779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:02.067469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20b89b-fba1-4699-a638-05fa17c1a9a3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:02.073924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:02.073924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:02.073924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:02.085103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] PATH_INFO: `/v3/projects/f0c90c35ee3e44c78e94a3e654b9a467` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:02.088857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c90c35ee3e44c78e94a3e654b9a467)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:02.093800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:02.251283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7ce671d6994e02be37d9b4fc7efbb5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.273962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7ce671d6994e02be37d9b4fc7efbb5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.274731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7ce671d6994e02be37d9b4fc7efbb5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.275392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7ce671d6994e02be37d9b4fc7efbb5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.339439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c90c35ee3e44c78e94a3e654b9a467', 'request_id': 'req-3a3a2a2e-f151-4227-816c-0d22a5a50941'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.382441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c90c35ee3e44c78e94a3e654b9a467', 'request_id': 'req-3a3a2a2e-f151-4227-816c-0d22a5a50941'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.401010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c90c35ee3e44c78e94a3e654b9a467', 'request_id': 'req-3a3a2a2e-f151-4227-816c-0d22a5a50941'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.408557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f47b6cf-0a67-411e-9aa8-5271ff8726fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7ce671d6994e02be37d9b4fc7efbb5'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.458981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 898/1794] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:01 2022] DELETE /identity/v3/users/af7ce671d6994e02be37d9b4fc7efbb5 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:02.499702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] The token cache is being invalidate because project f0c90c35ee3e44c78e94a3e654b9a467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:02.504853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.504853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a3a2a2e-f151-4227-816c-0d22a5a50941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:02.504853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 897/1795] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:02 2022] DELETE /identity/v3/projects/f0c90c35ee3e44c78e94a3e654b9a467 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:02.507939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:02.508314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:02.508674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:02.536442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:02.537877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:02.655712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:02.656548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:02.657045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:02.677315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 899/1796] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:02.732600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:02.744126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:02.788211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 898/1797] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:02.792435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:02.813769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d71f27-9e61-44ab-af2c-43922da3af7e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:02.849553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:02.850752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:02.852300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:02.852807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:02.853917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:02.854936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:02.860376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:02.887928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 900/1798] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:02.890434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:02.911571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebed80a-61ab-4004-ab05-e15bf6836ded None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:02.914915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e844168-5ba3-467c-9393-3f27d995244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:02.916639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844168-5ba3-467c-9393-3f27d995244f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:02.917160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844168-5ba3-467c-9393-3f27d995244f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:02.918121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844168-5ba3-467c-9393-3f27d995244f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:02.919231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844168-5ba3-467c-9393-3f27d995244f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:02.924231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844168-5ba3-467c-9393-3f27d995244f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:03.192683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 899/1799] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:02 2022] POST /identity/v3/projects => generated 369 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:03.198091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:03.221367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7fa9f-d7bc-480d-99bf-d3c2b0e54989 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:03.314572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f77a0-48f5-4189-ae9b-5a657a17f4a6 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:03.315473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f77a0-48f5-4189-ae9b-5a657a17f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:03.315994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f77a0-48f5-4189-ae9b-5a657a17f4a6 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:03.320998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 900/1800] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:49:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:49:03.349135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:03.349877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:03.352134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:03.401794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:03.407585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:03.407883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:03.408173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:03.408911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:03.420899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:03.456828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:03.466123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:03.616842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 901/1801] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:03 2022] POST /identity/v3/users => generated 285 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:03.621627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:03.662317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de8a0-70ea-47b5-95d2-9c83fa72c70e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:03.683839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:03.684635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:03.685029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:03.685698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:03.686885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:03.689381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:03.730652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 902/1802] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:03.732963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:03.764178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f2a8-4c68-4c9e-8a44-e3c8abf0177f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:03.766154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 901/1803] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:03.779412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1e57-b811-48a6-b28a-68a3cd8d7da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:03.780112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1e57-b811-48a6-b28a-68a3cd8d7da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:03.780403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1e57-b811-48a6-b28a-68a3cd8d7da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:03.780917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1e57-b811-48a6-b28a-68a3cd8d7da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:03.785763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1e57-b811-48a6-b28a-68a3cd8d7da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:03.787747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1e57-b811-48a6-b28a-68a3cd8d7da3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:03.813973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 903/1804] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:03.818710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:03.839675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0311-22ca-4b51-bf1c-f05d1beb3bda None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:03.847761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:03.849308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:03.849881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:03.850426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] PATH_INFO: `/v3/projects/c5523d0128b54f1eb10221c79209cb06/users/3a07ba62642b4db79aa5d9c9d710fe44/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:03.921516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5523d0128b54f1eb10221c79209cb06, user_id=3a07ba62642b4db79aa5d9c9d710fe44, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:03.944288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:04.051082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 902/1805] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:03 2022] PUT /identity/v3/projects/c5523d0128b54f1eb10221c79209cb06/users/3a07ba62642b4db79aa5d9c9d710fe44/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:04.061661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:04.063700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:04.064264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:04.096235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] MFA Rules not processed for user `3a07ba62642b4db79aa5d9c9d710fe44`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:04.098086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:04.308994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 904/1806] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:04.314126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:04.416642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23191a-f161-49ec-95b9-6eea358bcc5d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:04.435856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736bca-44a8-4804-bf55-6ee0dfb4fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:04.436691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736bca-44a8-4804-bf55-6ee0dfb4fd7c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:04.437011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736bca-44a8-4804-bf55-6ee0dfb4fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:04.437480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736bca-44a8-4804-bf55-6ee0dfb4fd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:04.438295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d736bca-44a8-4804-bf55-6ee0dfb4fd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:04.447511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d736bca-44a8-4804-bf55-6ee0dfb4fd7c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:04.595301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 903/1807] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:04 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:04.599379 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:04.616589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde6bac-94a7-4bc1-8c73-280a010e58aa None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:04.775557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:04.779070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:04.779804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:04.780320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:04.784259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:04.815890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:04.873869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249051c-2da4-4e6d-9c39-e16535afd02c None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:04.874574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249051c-2da4-4e6d-9c39-e16535afd02c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:04.875733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249051c-2da4-4e6d-9c39-e16535afd02c None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:04.879337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 904/1808] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:49:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:49:04.947615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:04.947822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:04.948488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:04.979263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:04.986115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:05.118380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 905/1809] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:04 2022] POST /identity/v3/users => generated 290 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:05.119563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:05.127835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:05.195792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 905/1810] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:05.196899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:05.234362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942216-20e4-4f0e-82e2-716482c84add None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:05.250421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:05.251116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:05.251404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:05.251694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:05.252461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:05.261081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:05.293134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 906/1811] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:05.300042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:05.320917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290563f-8d4f-45c5-9661-f374b3d214e4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:05.341744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:05.342774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:05.343069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:05.343494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] PATH_INFO: `/v3/projects/76fe61359f224422b99367dc489d5150/users/b11739e3750d489b885c872f4afd1f0e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:05.376670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fe61359f224422b99367dc489d5150, user_id=b11739e3750d489b885c872f4afd1f0e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:05.380676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6656be-1a9a-4adc-914b-cbf50441008c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:05.388666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:05.389383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:05.391100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:05.391633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:05.401057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:05.406526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:05.409383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:05.424239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 906/1812] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:05.594683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:05.596439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:05.624147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5c28-f6b7-4a89-bf69-65f0f4a85f0e service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:05.645558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:05.646418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:05.646709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:05.647090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] PATH_INFO: `/v3/projects/f05a5702fee44a8c8d7e7aaae87139a9` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:05.648284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05a5702fee44a8c8d7e7aaae87139a9)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:05.650494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:05.674320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 907/1813] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:05 2022] PUT /identity/v3/projects/76fe61359f224422b99367dc489d5150/users/b11739e3750d489b885c872f4afd1f0e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:05.675243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:05.891149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef03ecd-011e-4f80-b934-9fc75dd2d3f1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:05.906529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:05.907748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:05.908324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:05.908871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:05.910085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:05.914459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:05.944800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 908/1814] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:05.949061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:05.964335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:05.984461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513930a3-7254-47fc-ab57-53a071393d72 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:06.014826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05a5702fee44a8c8d7e7aaae87139a9', 'request_id': 'req-5977c704-487a-4422-81ec-6c5cb905a6e3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:06.161778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbb31b-0996-4934-9445-57f4b232878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:06.162655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb31b-0996-4934-9445-57f4b232878f admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.162949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb31b-0996-4934-9445-57f4b232878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.163264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb31b-0996-4934-9445-57f4b232878f admin admin] PATH_INFO: `/v3/projects/76fe61359f224422b99367dc489d5150/users/b11739e3750d489b885c872f4afd1f0e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.172285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbb31b-0996-4934-9445-57f4b232878f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fe61359f224422b99367dc489d5150, user_id=b11739e3750d489b885c872f4afd1f0e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:06.174737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05a5702fee44a8c8d7e7aaae87139a9', 'request_id': 'req-5977c704-487a-4422-81ec-6c5cb905a6e3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:06.181937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05a5702fee44a8c8d7e7aaae87139a9', 'request_id': 'req-5977c704-487a-4422-81ec-6c5cb905a6e3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:06.209177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbb31b-0996-4934-9445-57f4b232878f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:06.227958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] The token cache is being invalidate because project f05a5702fee44a8c8d7e7aaae87139a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:06.228262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:06.232251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5977c704-487a-4422-81ec-6c5cb905a6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:06.232386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 909/1815] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:05 2022] PUT /identity/v3/projects/76fe61359f224422b99367dc489d5150/users/b11739e3750d489b885c872f4afd1f0e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:06.232471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 907/1816] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:05 2022] DELETE /identity/v3/projects/f05a5702fee44a8c8d7e7aaae87139a9 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:06.245148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34817ce-0bfc-4538-893f-1bbc4cc60dd5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.247627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.250216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34817ce-0bfc-4538-893f-1bbc4cc60dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.250216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34817ce-0bfc-4538-893f-1bbc4cc60dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.251221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.253123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.306815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:06.310225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:06.331962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b34817ce-0bfc-4538-893f-1bbc4cc60dd5 None None] MFA Rules not processed for user `b11739e3750d489b885c872f4afd1f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:06.333429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b34817ce-0bfc-4538-893f-1bbc4cc60dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:06.465716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 910/1817] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:06.466766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:06.470462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:06.556015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 908/1818] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:06.557942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.558241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.558531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.608616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:06.610449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:06.617129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551662b-4e0a-475f-9e3a-39463fec195d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:06.627714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:06.628392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.628743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.629045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.631044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:06.635202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 909/1819] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:06.635962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:06.642185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:06.655063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:06.657029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:06.694420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 911/1820] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:06.696461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:06.737179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ac35c-645a-4de4-ab39-adb7f03920a5 service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:06.751727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:06.755463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.755463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.755463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.755463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:06.755463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:06.765993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:06.773731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbec42-2194-4a12-8a56-1ea8bbf0c1e8 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:06.781542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 912/1821] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:06.781864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:06.782744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.783042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.783329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.794472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:06.808897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:06.810469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:06.822438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149f87-9105-47f9-addb-da95995be4af admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:06.838527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:06.839702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:06.840315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:06.840801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:06.841330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 910/1822] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:06.842230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:06.847963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:07.151049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 913/1823] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:06 2022] POST /identity/v3/projects => generated 387 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:07.155787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:07.174331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112e1f-e468-4dea-9a4f-c83ade0b2730 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:07.340611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:07.341755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:07.342306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:07.342841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:07.346101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:07.348580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:07.554605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 911/1824] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:07 2022] POST /identity/v3/users => generated 294 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:07.558994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:07.578418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213799-63fc-486d-84ac-00ba7e6d5a7c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:07.596211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:07.596922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:07.597348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:07.597603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:07.598342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:07.606195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:07.634559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 914/1825] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:07.641636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:07.662756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22dd7-5bb2-4d3b-b5e1-91483ee3c29b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:07.682942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a3ea4-92c6-4e14-8236-201444084f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:07.685327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3ea4-92c6-4e14-8236-201444084f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:07.688170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3ea4-92c6-4e14-8236-201444084f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:07.688170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a3ea4-92c6-4e14-8236-201444084f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:07.688170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a3ea4-92c6-4e14-8236-201444084f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:07.694821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a3ea4-92c6-4e14-8236-201444084f5a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:07.726156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 912/1826] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:07.727740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:07.742021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0afa4-a6e0-4d0f-8323-23b29d856ddf admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:07.759470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:07.760895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:07.761352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:07.761677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] PATH_INFO: `/v3/projects/8b046bcb98b940e0b77e0d5d9c62075f/users/2c7555a491584132a4286a630f2169ef/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:07.977962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:07.990978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b046bcb98b940e0b77e0d5d9c62075f, user_id=2c7555a491584132a4286a630f2169ef, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:07.998054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:08.069961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 915/1827] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:07 2022] PUT /identity/v3/projects/8b046bcb98b940e0b77e0d5d9c62075f/users/2c7555a491584132a4286a630f2169ef/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:08.084950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:08.085255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:08.085629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:08.142138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] MFA Rules not processed for user `2c7555a491584132a4286a630f2169ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:08.143392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:08.215001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 913/1828] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:08.224158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:08.415004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289a4a-e914-4881-aab2-7053d46f946b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:08.442639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:08.444849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:08.445757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:08.446589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:08.458189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:08.461000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:08.693126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 916/1829] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:08 2022] POST /identity/v3/projects => generated 387 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:08.696236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:08.696878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda1582-13e6-4b4a-92c2-271fc81be63c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:08.788877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:08.789710 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:08.790044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:08.790329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:08.791117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:08.793207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:09.079829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 914/1830] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:08 2022] POST /identity/v3/users => generated 300 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:09.081238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:09.092011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc30a07-dc6c-48d6-aadd-b57bd8fc1b19 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:09.106329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:09.106329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:09.106329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:09.106329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:09.106781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:09.106781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:09.111769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 917/1831] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:09.115958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:09.129609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b241b54-7be4-4279-944e-0ca011feee7f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:09.134543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:09.135497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:09.135731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:09.136016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] PATH_INFO: `/v3/projects/be0022eebc7b4ea489df02ac3af186cf/users/4377590c683f4c829256bce0c957f94a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:09.152746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0022eebc7b4ea489df02ac3af186cf, user_id=4377590c683f4c829256bce0c957f94a, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:09.158050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:09.369531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 915/1832] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:09 2022] PUT /identity/v3/projects/be0022eebc7b4ea489df02ac3af186cf/users/4377590c683f4c829256bce0c957f94a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:09.378870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:09.388901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79eb3-6bd5-4f77-bced-2cca4d0e9624 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:09.453354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b531af3-c4d5-4b5c-8a8e-975bedf57515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:09.454579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531af3-c4d5-4b5c-8a8e-975bedf57515 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:09.454857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531af3-c4d5-4b5c-8a8e-975bedf57515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:09.455130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531af3-c4d5-4b5c-8a8e-975bedf57515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:09.455848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b531af3-c4d5-4b5c-8a8e-975bedf57515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:09.457469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b531af3-c4d5-4b5c-8a8e-975bedf57515 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:09.471208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 918/1833] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:09.475158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:09.488934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d54b-f1b7-4c6a-9156-9f6adb1b717b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:09.494245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:09.495365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:09.495801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:09.496481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] PATH_INFO: `/v3/projects/be0022eebc7b4ea489df02ac3af186cf/users/4377590c683f4c829256bce0c957f94a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:09.498793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0022eebc7b4ea489df02ac3af186cf, user_id=4377590c683f4c829256bce0c957f94a, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:09.502984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:09.537148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 916/1834] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:09 2022] PUT /identity/v3/projects/be0022eebc7b4ea489df02ac3af186cf/users/4377590c683f4c829256bce0c957f94a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:09.547925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:09.548518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:09.560582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:09.589902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] MFA Rules not processed for user `4377590c683f4c829256bce0c957f94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:09.591519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:09.694646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 919/1835] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:09.728009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:09.729595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:09.805964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b03156-2315-4162-8e79-aed814df0a01 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:09.809727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:09.810310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:09.810602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:09.810936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:09.820192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:09.821747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:09.831227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 917/1836] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:11.635226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:11.712734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4489-f382-49a0-9ca6-1669ac0faeaf None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:11.718170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:11.719119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:11.720136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:11.720698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] PATH_INFO: `/v3/users/2c7555a491584132a4286a630f2169ef` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:11.722090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7555a491584132a4286a630f2169ef)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:11.724049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:12.088733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7555a491584132a4286a630f2169ef'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.097643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7555a491584132a4286a630f2169ef'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.098438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7555a491584132a4286a630f2169ef'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.099159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7555a491584132a4286a630f2169ef'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.128568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8e03f1fd-9588-4644-a498-7a8b104286c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7555a491584132a4286a630f2169ef'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.224227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:12.228943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:12.263756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006f936-a922-4d8d-980a-9fccc054bccd service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:12.282496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:12.283435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:12.283867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:12.284158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] PATH_INFO: `/v3/users/3a07ba62642b4db79aa5d9c9d710fe44` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:12.286004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a07ba62642b4db79aa5d9c9d710fe44)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:12.287897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:12.307476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:12.310019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 920/1837] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:11 2022] DELETE /identity/v3/users/2c7555a491584132a4286a630f2169ef => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:12.318941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:12.319233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:12.319520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:12.362910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:12.365103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:12.494350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 921/1838] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:12.500539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a07ba62642b4db79aa5d9c9d710fe44'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.508930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:12.510779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:12.511854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a07ba62642b4db79aa5d9c9d710fe44'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.512555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a07ba62642b4db79aa5d9c9d710fe44'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.513172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a07ba62642b4db79aa5d9c9d710fe44'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.567767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d82f05-3e09-4761-8c99-5b20ee77eedf None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:12.571483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:12.572693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:12.572693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:12.572693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:12.574483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:12.586266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:12.587727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b433-9366-442e-9b9f-5008bd358c7d service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:12.597843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 922/1839] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:12.633118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a07ba62642b4db79aa5d9c9d710fe44'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:12.654875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 918/1840] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:12 2022] DELETE /identity/v3/users/3a07ba62642b4db79aa5d9c9d710fe44 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:12.659442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:12.659927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:12.660082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:12.682274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:12.682274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:12.738697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 923/1841] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:12.748478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:12.749888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:12.793022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:12.807727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052fd3-587b-43d1-8d57-3a561c9bdd04 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:12.811492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:12.812151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:12.812438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:12.812719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:12.822200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:12.823647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:12.835175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 919/1842] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:13.036761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:13.038996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:13.054239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe59-158e-484d-bf48-59f254f57ea6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:13.060957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:13.061963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:13.066206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:13.066206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] PATH_INFO: `/v3/projects/8b046bcb98b940e0b77e0d5d9c62075f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:13.066206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b046bcb98b940e0b77e0d5d9c62075f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:13.066595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:13.238991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b046bcb98b940e0b77e0d5d9c62075f', 'request_id': 'req-55070585-d625-4b85-ad07-9d85cbd0e53e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.253469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b046bcb98b940e0b77e0d5d9c62075f', 'request_id': 'req-55070585-d625-4b85-ad07-9d85cbd0e53e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.258236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b046bcb98b940e0b77e0d5d9c62075f', 'request_id': 'req-55070585-d625-4b85-ad07-9d85cbd0e53e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.358628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] The token cache is being invalidate because project 8b046bcb98b940e0b77e0d5d9c62075f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:13.358920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.364755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.366528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 924/1843] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:13 2022] DELETE /identity/v3/projects/8b046bcb98b940e0b77e0d5d9c62075f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:13.371979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:13.400131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c945ab-ddb8-4484-b42d-7148a243aa1f service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:13.487181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:13.494743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:13.542912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:13.544256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:13.544728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:13.545202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] PATH_INFO: `/v3/users/4377590c683f4c829256bce0c957f94a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:13.547856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4377590c683f4c829256bce0c957f94a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:13.552595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:13.636983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070585-d625-4b85-ad07-9d85cbd0e53e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:13.645156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:13.646297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:13.646729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:13.647162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] PATH_INFO: `/v3/projects/c5523d0128b54f1eb10221c79209cb06` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:13.649953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5523d0128b54f1eb10221c79209cb06)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:13.652108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:13.801251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4377590c683f4c829256bce0c957f94a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.804664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5523d0128b54f1eb10221c79209cb06', 'request_id': 'req-6ec47120-d0d0-4af1-8d59-82b078dd459d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.808240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4377590c683f4c829256bce0c957f94a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.808980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4377590c683f4c829256bce0c957f94a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.809949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4377590c683f4c829256bce0c957f94a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.810388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5523d0128b54f1eb10221c79209cb06', 'request_id': 'req-6ec47120-d0d0-4af1-8d59-82b078dd459d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.817392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5523d0128b54f1eb10221c79209cb06', 'request_id': 'req-6ec47120-d0d0-4af1-8d59-82b078dd459d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.907373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4377590c683f4c829256bce0c957f94a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:13.908766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:13.926689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 920/1844] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:13 2022] DELETE /identity/v3/users/4377590c683f4c829256bce0c957f94a => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:14.559553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] The token cache is being invalidate because project c5523d0128b54f1eb10221c79209cb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:14.559998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:14.565742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-6ec47120-d0d0-4af1-8d59-82b078dd459d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:14.575081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 925/1845] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:13 2022] DELETE /identity/v3/projects/c5523d0128b54f1eb10221c79209cb06 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:14.578158 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:14.580764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:14.682705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea704-05d8-4f8f-9b8e-3121c7e49127 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:14.687637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:14.688522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:14.689914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:14.690200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] PATH_INFO: `/v3/users/b11739e3750d489b885c872f4afd1f0e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:14.691480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11739e3750d489b885c872f4afd1f0e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:14.693741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:15.080845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11739e3750d489b885c872f4afd1f0e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.113747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11739e3750d489b885c872f4afd1f0e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.115125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11739e3750d489b885c872f4afd1f0e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.125198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11739e3750d489b885c872f4afd1f0e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.175317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae1ce-03e1-4cc6-9fa3-40aba48f0c52 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:15.175870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae1ce-03e1-4cc6-9fa3-40aba48f0c52 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:15.175870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae1ce-03e1-4cc6-9fa3-40aba48f0c52 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:15.177295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 926/1846] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:49:15.185907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:15.186380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:15.186890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:15.209871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:15.211102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:15.223900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:15.224254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11739e3750d489b885c872f4afd1f0e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.260936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 921/1847] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:14 2022] DELETE /identity/v3/users/b11739e3750d489b885c872f4afd1f0e => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:15.315906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 927/1848] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:15.333474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:15.335110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:15.350328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:15.353320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:15.372922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46cf4c-4e5b-42d3-ad9f-35e06f667375 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:15.471746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:15.472628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:15.472915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:15.473195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] PATH_INFO: `/v3/projects/be0022eebc7b4ea489df02ac3af186cf` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:15.474520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0022eebc7b4ea489df02ac3af186cf)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:15.476487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:15.479860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb682ce-87c2-4870-8d39-19eae050b7d7 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:15.500487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9862b8-7e4b-4f32-81f7-1d58421967bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:15.501241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9862b8-7e4b-4f32-81f7-1d58421967bc service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:15.501540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9862b8-7e4b-4f32-81f7-1d58421967bc service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:15.502144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9862b8-7e4b-4f32-81f7-1d58421967bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:15.514251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9862b8-7e4b-4f32-81f7-1d58421967bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:15.517928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9862b8-7e4b-4f32-81f7-1d58421967bc service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:15.531825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 922/1849] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:15.659616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0022eebc7b4ea489df02ac3af186cf', 'request_id': 'req-00bf878c-5934-451d-982a-f65cbb44484a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.666274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0022eebc7b4ea489df02ac3af186cf', 'request_id': 'req-00bf878c-5934-451d-982a-f65cbb44484a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.673499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0022eebc7b4ea489df02ac3af186cf', 'request_id': 'req-00bf878c-5934-451d-982a-f65cbb44484a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.822746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] The token cache is being invalidate because project be0022eebc7b4ea489df02ac3af186cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:15.822954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.823618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:15.825590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 928/1850] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:15 2022] DELETE /identity/v3/projects/be0022eebc7b4ea489df02ac3af186cf => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:15.831070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0077-0348-4d2b-bbf5-772ab7fab02b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:15.831717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0077-0348-4d2b-bbf5-772ab7fab02b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:15.832072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0077-0348-4d2b-bbf5-772ab7fab02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:15.852764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-edac0077-0348-4d2b-bbf5-772ab7fab02b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:15.854066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-edac0077-0348-4d2b-bbf5-772ab7fab02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:15.927325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:15.928880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:15.953489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 923/1851] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:15.963820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:15.963820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:15.963820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:15.983529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:15.992261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:15.993963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 924/1852] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:15.998219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.006882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf878c-5934-451d-982a-f65cbb44484a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.007812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5571a5-9fa7-42b9-8cc2-75d88fd0bd2a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.011834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.012625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.012763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.012979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.013090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.013261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] PATH_INFO: `/v3/projects/76fe61359f224422b99367dc489d5150` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.013374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.013646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.014375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:16.014821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.014930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fe61359f224422b99367dc489d5150)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.016444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.016787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.029186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 925/1853] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:49:16.033556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.043186 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a207f-6e49-4cdd-8f3c-cdc32df0eece admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.047793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.049979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.049979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.049979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.049979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.051731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.130416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fe61359f224422b99367dc489d5150', 'request_id': 'req-05fb849a-06e0-4870-a883-002fb29c6152'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:16.136499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fe61359f224422b99367dc489d5150', 'request_id': 'req-05fb849a-06e0-4870-a883-002fb29c6152'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:16.143161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fe61359f224422b99367dc489d5150', 'request_id': 'req-05fb849a-06e0-4870-a883-002fb29c6152'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:16.153725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 926/1854] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:16.154602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.217673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] The token cache is being invalidate because project 76fe61359f224422b99367dc489d5150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:16.218139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:16.222877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-05fb849a-06e0-4870-a883-002fb29c6152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:16.222877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 929/1855] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:15 2022] DELETE /identity/v3/projects/76fe61359f224422b99367dc489d5150 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:16.226422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ce16c-9ad5-4494-aa1c-7900b86ef6c5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.226897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ce16c-9ad5-4494-aa1c-7900b86ef6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.227353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ce16c-9ad5-4494-aa1c-7900b86ef6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.249599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a75ce16c-9ad5-4494-aa1c-7900b86ef6c5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:16.251530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a75ce16c-9ad5-4494-aa1c-7900b86ef6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:16.257488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba105-a711-4f42-82a0-afbbf9559549 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.262060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 930/1856] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:16.270381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.270952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.271424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.274245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.275205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.275515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.275801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.276601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.280559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.297468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:16.300582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:16.310081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 931/1857] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:16.314468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.323878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b8ea-33da-42ed-bb8d-94d4b082b87d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.328575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.329260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.330233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.330520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.331394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:16.331672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.333307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.343652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 927/1858] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:16.349665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 932/1859] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:49:16.354396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.354800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.357467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:16.369940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88397d-658b-4c2a-b733-50f889b3d21a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.373794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.374727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.375121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.375484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.376553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.379890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473065a5-4b02-4b73-90df-92b956d90069 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.380482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.386070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.386658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.386941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.387216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.387935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.389610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.409429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 933/1860] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:16.413394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.422988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6281-e352-4f45-b8c8-7441205e9ed7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.427944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.428611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.428903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.429190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.429948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.431568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.442464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 934/1861] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:16.446933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.458537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3b07-fdaf-4dec-afec-f638b48369a9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.464093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5e080-5d83-4869-9ab3-7b61b310d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.465298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5e080-5d83-4869-9ab3-7b61b310d2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.465602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5e080-5d83-4869-9ab3-7b61b310d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.465954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5e080-5d83-4869-9ab3-7b61b310d2f6 admin admin] PATH_INFO: `/v3/projects/0310b6f6eec44ea08aab4c40b50bddc3/users/6146910470cb4aea904436671dd3de01/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.481126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5e080-5d83-4869-9ab3-7b61b310d2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0310b6f6eec44ea08aab4c40b50bddc3, user_id=6146910470cb4aea904436671dd3de01, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.483859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5e080-5d83-4869-9ab3-7b61b310d2f6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.526635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 928/1862] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:16.530681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.592074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f219-21bf-4d65-8446-a2bcc07404f9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.598633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 935/1863] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:16 2022] PUT /identity/v3/projects/0310b6f6eec44ea08aab4c40b50bddc3/users/6146910470cb4aea904436671dd3de01/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:16.600302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.600592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.600894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.617840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:16.618953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:16.648756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.649460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.649744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.650038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.650860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.652871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.677798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 936/1864] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:16.687614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.689582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:16.747477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5074a69-8005-4d83-87f3-40315dea13de None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.751192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.752571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.752869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.753158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.763112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.764568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.766247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 929/1865] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:16 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:16.771024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.775811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 937/1866] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:16.781795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f72299-a34e-41ce-9a85-5072ebccb82d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.788955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.789854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.790204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.790595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.791401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.793061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.803824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 930/1867] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:16.807810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.818537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2e567-0cb0-43ec-894b-924fb44b07b2 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.823496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f9d5-850d-41b4-ab08-84aa184bf60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.824287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f9d5-850d-41b4-ab08-84aa184bf60a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.824579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f9d5-850d-41b4-ab08-84aa184bf60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.824884 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f9d5-850d-41b4-ab08-84aa184bf60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.825659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8f9d5-850d-41b4-ab08-84aa184bf60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.827276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8f9d5-850d-41b4-ab08-84aa184bf60a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:16.838339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 938/1868] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:16.849064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:16.859655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3cb9a-640b-47a4-8926-0b2967a36f20 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:16.865934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:16.867003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:16.867292 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:16.867576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] PATH_INFO: `/v3/projects/560505b563c04687935ae66b343b2965/users/24ef825cef254aa39499b5a72e5c641e/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:16.886217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560505b563c04687935ae66b343b2965, user_id=24ef825cef254aa39499b5a72e5c641e, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:16.886603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:17.007756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 931/1869] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:16 2022] PUT /identity/v3/projects/560505b563c04687935ae66b343b2965/users/24ef825cef254aa39499b5a72e5c641e/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:17.019268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:17.019560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:17.020013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:17.050529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] MFA Rules not processed for user `24ef825cef254aa39499b5a72e5c641e`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:17.051934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:17.069367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:17.145119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 939/1870] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:17.148335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:17.226545 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80933-0ef3-4b48-9c57-1e593a3c5b53 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:17.232972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:17.234237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:17.235327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:17.235701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:17.237090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:17.239638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:17.390052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 932/1871] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:17 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:17.394604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:17.411863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249e9a-80ab-4156-88e2-7666fd6efe59 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:17.525540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:17.526243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:17.526532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:17.526818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:17.527528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:17.531402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:17.538311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:17.643270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 940/1872] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:17 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:17.649948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:17.671266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e5ab-470b-4fb6-bccc-1f67c43cc3f0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:17.683845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:17.684648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:17.684944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:17.686308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:17.691664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:17.693195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:17.717091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 933/1873] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:17.723173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:17.737064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a72b-62e2-4f4f-a921-73d8167c0605 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:17.742739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:17.744061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:17.744414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:17.744810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] PATH_INFO: `/v3/projects/971bdcf069a14413bc4ca98c956a4fd7/users/1188b1693cf447c6ade4c758d2424bb8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:17.766935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971bdcf069a14413bc4ca98c956a4fd7, user_id=1188b1693cf447c6ade4c758d2424bb8, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:17.770854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:17.870578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 941/1874] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:17 2022] PUT /identity/v3/projects/971bdcf069a14413bc4ca98c956a4fd7/users/1188b1693cf447c6ade4c758d2424bb8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:17.876482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:17.889797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a7094-9d17-45b7-93dd-003f5e39546e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:17.972083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebb9f-cde4-4b96-aac6-f5c11ac670c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:17.977816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebb9f-cde4-4b96-aac6-f5c11ac670c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:17.977816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebb9f-cde4-4b96-aac6-f5c11ac670c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:17.977816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebb9f-cde4-4b96-aac6-f5c11ac670c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:17.977816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebb9f-cde4-4b96-aac6-f5c11ac670c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:17.977816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebb9f-cde4-4b96-aac6-f5c11ac670c2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:17.987575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 934/1875] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:17.997876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:18.008902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9911c-aabc-4455-a8d7-aa84fb10d0f2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:18.013547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:18.014427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.014712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.015093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] PATH_INFO: `/v3/projects/971bdcf069a14413bc4ca98c956a4fd7/users/1188b1693cf447c6ade4c758d2424bb8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.028248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=971bdcf069a14413bc4ca98c956a4fd7, user_id=1188b1693cf447c6ade4c758d2424bb8, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:18.028248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:18.032510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 942/1876] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:17 2022] PUT /identity/v3/projects/971bdcf069a14413bc4ca98c956a4fd7/users/1188b1693cf447c6ade4c758d2424bb8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:18.042641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.042941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.043224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.071226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] MFA Rules not processed for user `1188b1693cf447c6ade4c758d2424bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:18.072497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:18.153222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 935/1877] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:18.161865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:18.163731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:18.230360 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571fa52-52aa-415c-9cbc-057bfc41adeb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:18.234458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf747a1-7ec4-49a5-997f-436b2703e9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:18.235213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf747a1-7ec4-49a5-997f-436b2703e9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.235559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf747a1-7ec4-49a5-997f-436b2703e9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.235910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf747a1-7ec4-49a5-997f-436b2703e9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.246499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf747a1-7ec4-49a5-997f-436b2703e9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:18.248080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf747a1-7ec4-49a5-997f-436b2703e9d9 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:18.264084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 943/1878] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:18.300577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:18.372144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ab5c-0619-4a04-b71b-5ece477404c7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:18.376669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:18.378787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.379073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.379363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] PATH_INFO: `/v3/users/24ef825cef254aa39499b5a72e5c641e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.382091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ef825cef254aa39499b5a72e5c641e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:18.384118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:18.417474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.417987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.417987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.448596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] MFA Rules not processed for user `6146910470cb4aea904436671dd3de01`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:18.449954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:18.531934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 944/1879] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:18.536025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:18.549726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b86c-be5c-4c20-96a3-a8951b40ee3c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:18.555324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:18.556129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.556490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.556848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.557657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:18.559688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:18.572120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ef825cef254aa39499b5a72e5c641e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:18.588252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ef825cef254aa39499b5a72e5c641e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:18.589238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ef825cef254aa39499b5a72e5c641e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:18.589875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ef825cef254aa39499b5a72e5c641e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:18.728267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 945/1880] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:18 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:18.729864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:18.732296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:18.762493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5f940218-3293-4e20-aebe-f8624572390f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ef825cef254aa39499b5a72e5c641e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:18.793552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 936/1881] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:18 2022] DELETE /identity/v3/users/24ef825cef254aa39499b5a72e5c641e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:18.797867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.798165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.798457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.824411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:18.825964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:18.828100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2090807-d7d5-4755-a640-15b205cb1605 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:18.900258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 937/1882] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:18.903599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:18.904955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.905397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.905805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:18.915401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:18.917472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:18.917960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:18.920230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:18.993983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a5ffa-9886-4fb1-b211-d2427d83bd3e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:18.998487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:18.999310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:18.999595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:18.999905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:19.010435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:19.011883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:19.014432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 946/1883] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:18 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:19.019990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:19.022965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 938/1884] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:19.030405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eda42-61bf-49d5-9220-def62771786a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:19.036369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:19.037114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:19.037446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:19.037731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:19.038560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:19.040212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:19.052252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 947/1885] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:19.056691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:19.067430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d83944-07bd-44f1-8e34-7f3033714eb9 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:19.072697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:19.073649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:19.073932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:19.074211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] PATH_INFO: `/v3/projects/78f367fbdec64d559c9550686cbcab9a/users/8b5838cb5263477f9a9889be7a48c746/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:19.092994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f367fbdec64d559c9550686cbcab9a, user_id=8b5838cb5263477f9a9889be7a48c746, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:19.096267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:19.275610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 939/1886] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:19 2022] PUT /identity/v3/projects/78f367fbdec64d559c9550686cbcab9a/users/8b5838cb5263477f9a9889be7a48c746/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:19.279841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:19.290962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526401-0725-40c6-ae2d-63604c0a03ff admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:19.363782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:19.364592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:19.364949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:19.365926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:19.366779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:19.368617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:19.380415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 948/1887] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:19.384910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:19.402929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708946e-13b7-40bf-8e62-b64bbf580496 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:19.410250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:19.410892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:19.411178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:19.411467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] PATH_INFO: `/v3/projects/78f367fbdec64d559c9550686cbcab9a/users/8b5838cb5263477f9a9889be7a48c746/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:19.413549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f367fbdec64d559c9550686cbcab9a, user_id=8b5838cb5263477f9a9889be7a48c746, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:19.416218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:19.429670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 940/1888] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:19 2022] PUT /identity/v3/projects/78f367fbdec64d559c9550686cbcab9a/users/8b5838cb5263477f9a9889be7a48c746/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:19.664662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:19.666296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:19.685983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f1a3-67df-4e7e-b302-6fe3b7436fbe admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:19.724394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:19.746157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:19.746959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:19.747252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:19.747563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] PATH_INFO: `/v3/projects/560505b563c04687935ae66b343b2965` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:19.748778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=560505b563c04687935ae66b343b2965)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:19.750732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:19.888561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560505b563c04687935ae66b343b2965', 'request_id': 'req-215648c2-d724-45d0-addc-528ed7d560ab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:19.894626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560505b563c04687935ae66b343b2965', 'request_id': 'req-215648c2-d724-45d0-addc-528ed7d560ab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:19.902149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560505b563c04687935ae66b343b2965', 'request_id': 'req-215648c2-d724-45d0-addc-528ed7d560ab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:19.983162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] The token cache is being invalidate because project 560505b563c04687935ae66b343b2965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:19.988022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:19.988022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:19.988022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 949/1889] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:19 2022] DELETE /identity/v3/projects/560505b563c04687935ae66b343b2965 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:19.990731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:19.992721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:20.009009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038faf5-3caf-41df-b791-22d134150633 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:20.077970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:20.080615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:20.082539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:20.083008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:20.083463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] PATH_INFO: `/v3/users/1188b1693cf447c6ade4c758d2424bb8` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:20.084985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1188b1693cf447c6ade4c758d2424bb8)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:20.087269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:20.379218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1188b1693cf447c6ade4c758d2424bb8'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:20.386861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1188b1693cf447c6ade4c758d2424bb8'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:20.387574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1188b1693cf447c6ade4c758d2424bb8'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:20.388220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1188b1693cf447c6ade4c758d2424bb8'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:20.497230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c7375505-f722-4e0a-a992-0aa8df384fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1188b1693cf447c6ade4c758d2424bb8'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:20.517026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 941/1890] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:19 2022] DELETE /identity/v3/users/1188b1693cf447c6ade4c758d2424bb8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:21.001242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:21.012543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215648c2-d724-45d0-addc-528ed7d560ab admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:21.074619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:21.075490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.075783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.076068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] PATH_INFO: `/v3/projects/971bdcf069a14413bc4ca98c956a4fd7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.077246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971bdcf069a14413bc4ca98c956a4fd7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:21.079259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:21.236606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971bdcf069a14413bc4ca98c956a4fd7', 'request_id': 'req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:21.242939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971bdcf069a14413bc4ca98c956a4fd7', 'request_id': 'req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:21.249817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971bdcf069a14413bc4ca98c956a4fd7', 'request_id': 'req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:21.270700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d57e-61a5-4ff6-867f-811676cfc03a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.271190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d57e-61a5-4ff6-867f-811676cfc03a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.271270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d57e-61a5-4ff6-867f-811676cfc03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.318334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-39d6d57e-61a5-4ff6-867f-811676cfc03a None None] MFA Rules not processed for user `8b5838cb5263477f9a9889be7a48c746`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:21.319731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-39d6d57e-61a5-4ff6-867f-811676cfc03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:21.407557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] The token cache is being invalidate because project 971bdcf069a14413bc4ca98c956a4fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:21.407923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:21.408660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:21.413444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 942/1892] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:21.414993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 950/1892] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:21 2022] DELETE /identity/v3/projects/971bdcf069a14413bc4ca98c956a4fd7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:21.418118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15ac9d-6d77-460c-aa1d-18fc4f83cbf5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.418717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15ac9d-6d77-460c-aa1d-18fc4f83cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.419280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15ac9d-6d77-460c-aa1d-18fc4f83cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.422945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:21.424576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:21.444981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8b15ac9d-6d77-460c-aa1d-18fc4f83cbf5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:21.446706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8b15ac9d-6d77-460c-aa1d-18fc4f83cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:21.495951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226bfb1-2b7f-4fab-9fc3-a7fc9c69c3f8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:21.499828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:21.500491 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.500781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.501063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.503606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:21.516080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 943/1893] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:21.524384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.524694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.524960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.527463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:21.544637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:21.545819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:21.556768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 944/1894] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:21.561547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:21.571781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f808cb0-2ab2-4e12-b253-59b9448208e0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:21.572371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:21.573952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:21.576483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:21.577137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.581443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.581443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.581443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:21.581443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:21.581443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:21.583874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 951/1895] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:21.597674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 945/1896] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:49:21.598826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:21.609501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf8c4-f076-4ef5-96f0-e3a95d5ec557 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:21.614138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:21.614794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.615131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.615470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.616085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:21.618079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:21.623007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:21.749977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 952/1897] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:21 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:21.751114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:21.761880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e9fb-ce32-4434-aa94-92936e61eb7c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:21.839467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:21.839467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:21.840331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:21.840630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:21.841632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:21.844245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.047815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 946/1898] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:21 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:22.050259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.060897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158e98-fcdc-4b38-b552-7023dbb3f376 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.066291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.066963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.067252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.067535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.068416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.070064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.083655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 953/1899] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:22.088220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.117703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e817d-221f-45e0-b113-cce2e09e1a0f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.123231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1167-f38b-481c-9cad-f5fc5569f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.123915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1167-f38b-481c-9cad-f5fc5569f64a admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.124207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1167-f38b-481c-9cad-f5fc5569f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.124498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1167-f38b-481c-9cad-f5fc5569f64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.125252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1167-f38b-481c-9cad-f5fc5569f64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.127037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1167-f38b-481c-9cad-f5fc5569f64a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.138666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 947/1900] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:22.142839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.153846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62d378-c385-4357-96c6-5291e042a13b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.158556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.160139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.160425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.160708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] PATH_INFO: `/v3/projects/4b551441acff459597fe61c3d6af5e13/users/aac9ddd69d8f4bffa3d78b88d4d7a30f/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.177519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b551441acff459597fe61c3d6af5e13, user_id=aac9ddd69d8f4bffa3d78b88d4d7a30f, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.180182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.344374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 954/1901] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:22 2022] PUT /identity/v3/projects/4b551441acff459597fe61c3d6af5e13/users/aac9ddd69d8f4bffa3d78b88d4d7a30f/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:22.355745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.356257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.356363 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.387706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] MFA Rules not processed for user `aac9ddd69d8f4bffa3d78b88d4d7a30f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:22.387706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:22.457619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 948/1902] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:22.461902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.552386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cc86-78ce-4d5a-9638-4c205be85942 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.558230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.558456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.558802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.559426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.560106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.562317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.677422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 955/1903] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:22 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:22.682776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.694670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b256-7159-48bd-a1f3-4267fc3ec587 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.750082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.750789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.751049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.751330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.752024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.754802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.875179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 949/1904] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:22 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:22.878687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.889085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7aa76-5d1c-4d08-8972-d65a8327b982 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.894300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.895025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.895327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.895608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.896392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.898028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:22.909564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 956/1905] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:22.913527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:22.923559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd833-dfac-4ef5-bd17-da6d76c7cd44 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:22.928278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:22.929166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:22.929494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:22.938436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] PATH_INFO: `/v3/projects/0f9916bc89ef4872ab703fe0f79d84e8/users/9bf24de18af8440c93fda8a655e4151e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:22.946061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9916bc89ef4872ab703fe0f79d84e8, user_id=9bf24de18af8440c93fda8a655e4151e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:22.948698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:23.022099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 950/1906] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:22 2022] PUT /identity/v3/projects/0f9916bc89ef4872ab703fe0f79d84e8/users/9bf24de18af8440c93fda8a655e4151e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:23.024953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:23.037807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a4ff-7d85-43cb-a88c-887850cf29db admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:23.106667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a9668-13eb-47fc-8164-34967db68c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:23.108013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a9668-13eb-47fc-8164-34967db68c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.108700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a9668-13eb-47fc-8164-34967db68c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.109058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a9668-13eb-47fc-8164-34967db68c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.110070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a9668-13eb-47fc-8164-34967db68c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:23.112437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a9668-13eb-47fc-8164-34967db68c87 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:23.125042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 957/1907] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:23.134050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:23.141116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa4db-aaca-4ba1-a63c-33cf09e5b751 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:23.159740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:23.161606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.161998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.163205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] PATH_INFO: `/v3/projects/0f9916bc89ef4872ab703fe0f79d84e8/users/9bf24de18af8440c93fda8a655e4151e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.166366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9916bc89ef4872ab703fe0f79d84e8, user_id=9bf24de18af8440c93fda8a655e4151e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:23.170331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:23.183644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 951/1908] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:23 2022] PUT /identity/v3/projects/0f9916bc89ef4872ab703fe0f79d84e8/users/9bf24de18af8440c93fda8a655e4151e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:23.195234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.195527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.195980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.233708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] MFA Rules not processed for user `9bf24de18af8440c93fda8a655e4151e`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:23.234947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:23.292976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:23.308793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 958/1909] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:23.321025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:23.322736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:23.382467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f3d9-9388-4e8f-a754-086db73cd9bd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:23.386559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:23.387501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.387802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.388152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.399330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:23.400782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:23.410877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 952/1910] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:23.476618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:23.547193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048206b-89a1-47d9-a05c-8399cbb8d93b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:23.552634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:23.556006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.556006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.556006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] PATH_INFO: `/v3/users/aac9ddd69d8f4bffa3d78b88d4d7a30f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.556006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac9ddd69d8f4bffa3d78b88d4d7a30f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:23.558235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:23.666458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:23.676262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a743-41b8-4b17-8c2e-d6810f9b83fa service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:23.684914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:23.685613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.685905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.686189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.688072 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:23.763835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:23.766732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64216-1d36-44b2-b058-ff8d158729aa service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:23.778533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 953/1911] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:23.786708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac9ddd69d8f4bffa3d78b88d4d7a30f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:23.794078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac9ddd69d8f4bffa3d78b88d4d7a30f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:23.795390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac9ddd69d8f4bffa3d78b88d4d7a30f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:23.796099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac9ddd69d8f4bffa3d78b88d4d7a30f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:23.812547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac9ddd69d8f4bffa3d78b88d4d7a30f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:23.935764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 959/1912] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:23 2022] DELETE /identity/v3/users/aac9ddd69d8f4bffa3d78b88d4d7a30f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:23.940586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:23.940727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:23.940920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:23.965578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:23.965578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:24.029937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 954/1913] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:24.041495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:24.043053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:24.112203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268758-c39c-4225-a1ad-a2f6aeec235f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:24.116787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:24.117469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:24.117842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:24.118022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:24.129343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:24.130851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:24.141811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 960/1914] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:24.475934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:24.501013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:24.502635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:24.515470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6882-8876-44ad-815d-54607ce447cb None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:24.521954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:24.522849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:24.523136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:24.523421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] PATH_INFO: `/v3/users/bc4ae722077e434080b1e1f3306dfa80` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:24.524615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4ae722077e434080b1e1f3306dfa80)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:24.526652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:24.759028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:24.760917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:24.785164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fd36-0500-42c2-8958-32818d29a67f service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:24.792133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:24.793591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:24.794155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:24.794925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] PATH_INFO: `/v3/projects/4b551441acff459597fe61c3d6af5e13` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:24.798852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b551441acff459597fe61c3d6af5e13)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:24.802875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:24.830394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4ae722077e434080b1e1f3306dfa80'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:24.840482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4ae722077e434080b1e1f3306dfa80'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:24.841578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4ae722077e434080b1e1f3306dfa80'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:24.842649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4ae722077e434080b1e1f3306dfa80'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:24.974767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b551441acff459597fe61c3d6af5e13', 'request_id': 'req-3e03daf2-0164-4acd-bcb3-c14596c3718c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:24.977836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dde88960-bd60-410a-8666-fa0fa355faf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4ae722077e434080b1e1f3306dfa80'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.000201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b551441acff459597fe61c3d6af5e13', 'request_id': 'req-3e03daf2-0164-4acd-bcb3-c14596c3718c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.004813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 955/1915] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:24 2022] DELETE /identity/v3/users/bc4ae722077e434080b1e1f3306dfa80 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:25.008885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:25.013024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:25.013624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:25.015056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:25.015157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b551441acff459597fe61c3d6af5e13', 'request_id': 'req-3e03daf2-0164-4acd-bcb3-c14596c3718c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.045839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:25.049246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:25.099281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] The token cache is being invalidate because project 4b551441acff459597fe61c3d6af5e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:25.099571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.100724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.102850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 961/1916] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:24 2022] DELETE /identity/v3/projects/4b551441acff459597fe61c3d6af5e13 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:25.107617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:25.109201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:25.140265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 956/1917] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:25.147837 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:25.150991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:25.187972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03daf2-0164-4acd-bcb3-c14596c3718c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:25.193824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:25.194722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:25.195041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:25.195328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] PATH_INFO: `/v3/users/9bf24de18af8440c93fda8a655e4151e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:25.196567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf24de18af8440c93fda8a655e4151e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:25.198842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:25.215622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d1477-742d-4c97-b697-6ad7994413f4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:25.219563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:25.220195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:25.220484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:25.220766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:25.230723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:25.232208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:25.242813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 957/1918] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:25.428376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf24de18af8440c93fda8a655e4151e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.436575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf24de18af8440c93fda8a655e4151e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.437410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf24de18af8440c93fda8a655e4151e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.438758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf24de18af8440c93fda8a655e4151e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.454021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf24de18af8440c93fda8a655e4151e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:25.511082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 962/1919] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:25 2022] DELETE /identity/v3/users/9bf24de18af8440c93fda8a655e4151e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:25.841431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:25.843130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:25.857536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c158ee2-669e-497e-8231-00b1af45f491 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:25.925467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:25.926351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:25.926641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:25.926922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] PATH_INFO: `/v3/projects/548464a663c7402ba862fd0d6b24c138` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:25.928223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=548464a663c7402ba862fd0d6b24c138)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:25.930374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:26.058100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548464a663c7402ba862fd0d6b24c138', 'request_id': 'req-6060ff94-35bd-4c62-a10d-c41baa0b64ed'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.145522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548464a663c7402ba862fd0d6b24c138', 'request_id': 'req-6060ff94-35bd-4c62-a10d-c41baa0b64ed'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.151971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548464a663c7402ba862fd0d6b24c138', 'request_id': 'req-6060ff94-35bd-4c62-a10d-c41baa0b64ed'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.163983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] The token cache is being invalidate because project 548464a663c7402ba862fd0d6b24c138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:26.164279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.164940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.169481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 958/1920] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:25 2022] DELETE /identity/v3/projects/548464a663c7402ba862fd0d6b24c138 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:26.170665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:26.172303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:26.188694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6a8f-3b55-4c0a-9138-30da36068aeb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:26.259388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:26.261058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:26.285223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:26.285599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:26.285899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:26.286188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] PATH_INFO: `/v3/users/587dc236bebf4314b7c0f39b74f8162f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:26.287800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587dc236bebf4314b7c0f39b74f8162f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:26.290336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:26.368753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060ff94-35bd-4c62-a10d-c41baa0b64ed admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:26.373495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:26.374368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:26.374666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:26.374947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] PATH_INFO: `/v3/projects/0f9916bc89ef4872ab703fe0f79d84e8` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:26.376272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9916bc89ef4872ab703fe0f79d84e8)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:26.378885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:26.519752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587dc236bebf4314b7c0f39b74f8162f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.525977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9916bc89ef4872ab703fe0f79d84e8', 'request_id': 'req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.527525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587dc236bebf4314b7c0f39b74f8162f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.528604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587dc236bebf4314b7c0f39b74f8162f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.529143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587dc236bebf4314b7c0f39b74f8162f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.543274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ea4deee0-cf29-4655-b101-30a647340ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587dc236bebf4314b7c0f39b74f8162f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.635237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9916bc89ef4872ab703fe0f79d84e8', 'request_id': 'req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.635814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:26.642049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9916bc89ef4872ab703fe0f79d84e8', 'request_id': 'req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.654103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] The token cache is being invalidate because project 0f9916bc89ef4872ab703fe0f79d84e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:26.654396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.655055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dbf4e4d9-fe68-4b53-a322-aa08a1a5a57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:26.656689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 959/1921] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:26 2022] DELETE /identity/v3/projects/0f9916bc89ef4872ab703fe0f79d84e8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:26.662107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:26.662429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:26.662708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:26.680893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:26.682132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:26.732246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 963/1922] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:26 2022] DELETE /identity/v3/users/587dc236bebf4314b7c0f39b74f8162f => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:26.743404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 960/1923] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:26.751093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:26.751491 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:26.751838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:26.770792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:26.772060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:26.843385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 964/1924] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:26.848734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:26.860845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7928-1705-4c38-9102-6048053d0179 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:26.866521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:26.867191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:26.867478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:26.867909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:26.868790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:26.869190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:26.871104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:26.884556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 961/1925] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:49:26.894570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:26.905776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f22a-dbf2-496c-8a7a-f9d07290e628 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:26.912008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:26.912869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:26.916373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:26.916510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:26.917945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:26.920545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:26.968092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:27.029957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 965/1926] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:26 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:27.035327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.048939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3343-4a5b-460f-a395-515037807d2d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.137969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.138738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.139100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.139608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.140491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.142725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.236555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 962/1927] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:27 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:27.241913 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.255421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413cd5-035a-4b2d-b8ec-3f55814a3929 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.260051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.260736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.261026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.261338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.262392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.264212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.282240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 966/1928] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:27.287566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.301854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89392-382e-4d1d-a103-be1d41b7af71 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.306903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.308161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.308457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.308872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.309695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.311351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.336227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 963/1929] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:27.337388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.355056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5116-1d61-4864-991f-e3200609f002 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.382672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99051e5c-ac52-4c17-a485-766313ab8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.383581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99051e5c-ac52-4c17-a485-766313ab8f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.383864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99051e5c-ac52-4c17-a485-766313ab8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.384137 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99051e5c-ac52-4c17-a485-766313ab8f32 admin admin] PATH_INFO: `/v3/projects/fd53f42710864254b5089064e629cfc5/users/a4e2096f64544c2ba6c7e53a5ce8bb9d/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.402896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99051e5c-ac52-4c17-a485-766313ab8f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd53f42710864254b5089064e629cfc5, user_id=a4e2096f64544c2ba6c7e53a5ce8bb9d, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.405753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99051e5c-ac52-4c17-a485-766313ab8f32 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.501831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.505236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:27.520784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0374fd-9eca-44fc-af7c-fecd11b27f02 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.523619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 967/1930] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:27 2022] PUT /identity/v3/projects/fd53f42710864254b5089064e629cfc5/users/a4e2096f64544c2ba6c7e53a5ce8bb9d/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:27.538013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.538369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.539007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.570178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] MFA Rules not processed for user `a4e2096f64544c2ba6c7e53a5ce8bb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:27.571517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:27.635120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.635992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.636279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.636554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] PATH_INFO: `/v3/projects/d0856453e74d4a37a961ca4b512d8bee` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.637852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0856453e74d4a37a961ca4b512d8bee)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.639740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.677756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 968/1931] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:27.682384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.697217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dff6f4-18b7-4c9c-8d95-5682f134e502 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.709035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.710136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.710434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.710760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.711864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.715104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.804222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0856453e74d4a37a961ca4b512d8bee', 'request_id': 'req-9102727f-9600-44c2-9796-98bef9a5acfd'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:27.820794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 969/1932] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:27 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:27.825852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:27.875926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0856453e74d4a37a961ca4b512d8bee', 'request_id': 'req-9102727f-9600-44c2-9796-98bef9a5acfd'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:27.887585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0856453e74d4a37a961ca4b512d8bee', 'request_id': 'req-9102727f-9600-44c2-9796-98bef9a5acfd'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:27.907051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] The token cache is being invalidate because project d0856453e74d4a37a961ca4b512d8bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:27.908522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:27.910308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9102727f-9600-44c2-9796-98bef9a5acfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:27.913427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1408-092b-49dc-9e12-5088a6a7c6cc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:27.915432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 964/1933] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:27 2022] DELETE /identity/v3/projects/d0856453e74d4a37a961ca4b512d8bee => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:27.921175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed654e-f547-4a26-948f-564d90a87ee2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.921175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed654e-f547-4a26-948f-564d90a87ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.922220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed654e-f547-4a26-948f-564d90a87ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.922501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:27.923259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.923498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.923788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.924496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:27.926788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:27.946637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d2ed654e-f547-4a26-948f-564d90a87ee2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:27.948092 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d2ed654e-f547-4a26-948f-564d90a87ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:27.957961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 965/1934] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:27.966465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:27.969571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:27.969571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:27.990446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:27.991665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:27.999892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 966/1935] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:28.004235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.014119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ec0f-827f-4744-aff7-75d4085aabbf None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.020120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.022464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.022774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.023063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.023826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:28.024197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.033627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.033789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 970/1936] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:27 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:28.037268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.039094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:28.055516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14bfe3-3026-4740-8867-5b1bdc012537 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.056039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 967/1937] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:28.058084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.061007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.061770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.062208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.062402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.063127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.065214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.069679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aad92-85b6-4f84-b1fb-20dab664ca64 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.074493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.075359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.075639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.075921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.076619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.078601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 971/1938] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:28.082430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.083189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.093928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e565-7d08-4b1e-8952-de5a5827cb49 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.099849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.100529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.100816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.101101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.101886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.103541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.119423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 972/1939] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:28.120573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.131509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec69248-38b1-4066-a3b9-e947918ce631 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.138623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206cf2a-7448-4e4a-8eb8-e8ffd4d2a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.138806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206cf2a-7448-4e4a-8eb8-e8ffd4d2a0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.138966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206cf2a-7448-4e4a-8eb8-e8ffd4d2a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.139221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206cf2a-7448-4e4a-8eb8-e8ffd4d2a0c7 admin admin] PATH_INFO: `/v3/projects/63d6f35224284ef29d22794a1cb91d0c/users/47d11ca8f32b4f349e7366dffe49f019/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.156156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206cf2a-7448-4e4a-8eb8-e8ffd4d2a0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d6f35224284ef29d22794a1cb91d0c, user_id=47d11ca8f32b4f349e7366dffe49f019, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.158930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206cf2a-7448-4e4a-8eb8-e8ffd4d2a0c7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.177890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 968/1940] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:28.186335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.207828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:28.251730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792351-6396-4d98-b570-210e2f5e8959 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.265421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 973/1941] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:28 2022] PUT /identity/v3/projects/63d6f35224284ef29d22794a1cb91d0c/users/47d11ca8f32b4f349e7366dffe49f019/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:28.276225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.276633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.277134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.310445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] MFA Rules not processed for user `47d11ca8f32b4f349e7366dffe49f019`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:28.311746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:28.341492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.343138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.343626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.344069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.345104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.347322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.400974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 974/1942] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:28.405789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.416891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9a750-c562-46d7-8044-5b887fb76979 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.423375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.424100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.424443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.424664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.425487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.427628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.435708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:28.442389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 969/1943] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:28.442389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.452496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04466-3f6f-4cd1-b5b3-6b46db27b457 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.458329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.459011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.459301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.459582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.461068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.461973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.473969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 970/1944] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:28.480685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.493492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba469c2d-61c7-4175-8df0-e1c26c20abbf admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.500192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.501103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.501815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.501927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.502819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.505106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.517838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 971/1945] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:28.521981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.541141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 975/1946] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:28.543648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7106a-99bc-4ebb-bfc6-8e2ea468ae0d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.556415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.648318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e20817-2bfc-44e4-8c31-f3be65268bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.649397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20817-2bfc-44e4-8c31-f3be65268bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.649944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20817-2bfc-44e4-8c31-f3be65268bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.650114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20817-2bfc-44e4-8c31-f3be65268bd4 admin admin] PATH_INFO: `/v3/projects/ec069050815c4c7e9297c504e68c600b/users/709250c2514e406d81f2e0eb8707d495/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.655940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd031ccc-b644-48bf-93aa-aad9893caf7f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.660638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.660940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.661220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.661482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.662349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.664335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.666372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e20817-2bfc-44e4-8c31-f3be65268bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec069050815c4c7e9297c504e68c600b, user_id=709250c2514e406d81f2e0eb8707d495, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.669251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e20817-2bfc-44e4-8c31-f3be65268bd4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.749781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 972/1947] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:28 2022] PUT /identity/v3/projects/ec069050815c4c7e9297c504e68c600b/users/709250c2514e406d81f2e0eb8707d495/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:28.761947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.762352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.762771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.812338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] MFA Rules not processed for user `709250c2514e406d81f2e0eb8707d495`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:28.819316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 976/1948] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:28.819616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:28.820686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.833557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4959-d4bd-4ab2-a84a-b83fe06540aa admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:28.949406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:28.950411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:28.950868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:28.951691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:28.952220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:28.968939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:28.980701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 973/1949] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:28.984245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:28.986857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 977/1950] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:29.000395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f57b4e-8680-4493-a9ab-c177253012a6 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.003247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.012918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.014616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7f97-7d8c-43ce-9086-ced3ba77012a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.014737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.015346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.015546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.020292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.021242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.021705 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.021882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] PATH_INFO: `/v3/projects/ec36863f4fc54c14b951e9769547815e/users/be84fa0b8f3c4453af7420a527d3a62b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.030389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.034498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.042409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec36863f4fc54c14b951e9769547815e, user_id=be84fa0b8f3c4453af7420a527d3a62b, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.045382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.190130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 974/1951] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:28 2022] POST /identity/v3/projects => generated 389 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:29.191086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 978/1952] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:29 2022] PUT /identity/v3/projects/ec36863f4fc54c14b951e9769547815e/users/be84fa0b8f3c4453af7420a527d3a62b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:29.194763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.195957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.288957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c3837-a784-4a60-ae30-2391ef9d46f2 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.290273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74af8-f13e-4e2a-a312-e2cd2dd931ad admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.297364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487bbe1-c10e-481f-b515-cf1b72528367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.298228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487bbe1-c10e-481f-b515-cf1b72528367 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.298912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487bbe1-c10e-481f-b515-cf1b72528367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.299759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487bbe1-c10e-481f-b515-cf1b72528367 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.300066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487bbe1-c10e-481f-b515-cf1b72528367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.300739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.301537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.301908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.302758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.302891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487bbe1-c10e-481f-b515-cf1b72528367 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.303183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.304877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.322490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 979/1953] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:29.327172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.339719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db56a-b9bd-40b9-8bdf-a479bf99dd86 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.345053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.350023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.350023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.350023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] PATH_INFO: `/v3/projects/ec36863f4fc54c14b951e9769547815e/users/be84fa0b8f3c4453af7420a527d3a62b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.350023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec36863f4fc54c14b951e9769547815e, user_id=be84fa0b8f3c4453af7420a527d3a62b, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.352572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.364950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 980/1954] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:29 2022] PUT /identity/v3/projects/ec36863f4fc54c14b951e9769547815e/users/be84fa0b8f3c4453af7420a527d3a62b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:29.368823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 975/1955] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:29 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:29.374387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.375041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.375293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.375576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.410536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] MFA Rules not processed for user `be84fa0b8f3c4453af7420a527d3a62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:29.412835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:29.449973 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c543-b318-47e5-b0c7-db128411cbd8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.460272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.460963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.461254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.461588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.462473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.464144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.477454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 981/1956] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:29.481957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.494912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb28e2-8f91-4c1a-9b38-d4817025c669 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.500412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.501350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.501639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.501916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] PATH_INFO: `/v3/projects/391a91132a0348e196ebd33602833ccd/users/f8d78ec50b484c94b2faca220c5b0522/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.510063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 976/1957] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:29.539941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=391a91132a0348e196ebd33602833ccd, user_id=f8d78ec50b484c94b2faca220c5b0522, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.542879 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.601583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.603331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:29.664177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 982/1958] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:29 2022] PUT /identity/v3/projects/391a91132a0348e196ebd33602833ccd/users/f8d78ec50b484c94b2faca220c5b0522/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:29.668288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.719929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e5426-04bd-489a-a0f2-b5b0eef19444 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.783318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.783556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.783817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.784056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.868216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36240be9-a1f7-48f3-89a8-b223c90d8bab admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.899849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.900887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c416a-f210-4da2-b773-287a419181f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.901635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c416a-f210-4da2-b773-287a419181f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.903168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.903329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c416a-f210-4da2-b773-287a419181f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.903329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c416a-f210-4da2-b773-287a419181f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:29.903329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c416a-f210-4da2-b773-287a419181f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:29.904870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c416a-f210-4da2-b773-287a419181f0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:29.931824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 977/1959] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:29.932026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 983/1960] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:29.936553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:29.961218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a4c0-c94a-47bd-a5bb-3989ecad58ed service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:29.979214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:29.981484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:29.982403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:29.982782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:29.982963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] PATH_INFO: `/v3/projects/391a91132a0348e196ebd33602833ccd/users/f8d78ec50b484c94b2faca220c5b0522/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:30.008556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391a91132a0348e196ebd33602833ccd, user_id=f8d78ec50b484c94b2faca220c5b0522, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:30.017109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:30.049675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 978/1961] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:29 2022] PUT /identity/v3/projects/391a91132a0348e196ebd33602833ccd/users/f8d78ec50b484c94b2faca220c5b0522/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:30.063757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:30.064048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:30.064340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:30.123487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] MFA Rules not processed for user `f8d78ec50b484c94b2faca220c5b0522`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:30.124956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:30.170405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:30.245856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 984/1962] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:30.277375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:30.281847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:30.393763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64446d7f-9632-4faa-992b-03329369d4e5 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:30.405570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:30.406695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:30.406985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:30.407345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:30.435070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:30.436666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:30.476520 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 979/1963] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:31.126914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:31.830992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:31.950456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701acc8-134a-4251-82ed-5946f5633060 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:31.956636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:31.958263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:31.958577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:31.958848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] PATH_INFO: `/v3/users/709250c2514e406d81f2e0eb8707d495` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:31.961744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=709250c2514e406d81f2e0eb8707d495)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:31.965313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:32.203494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709250c2514e406d81f2e0eb8707d495'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:32.219747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709250c2514e406d81f2e0eb8707d495'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:32.227970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709250c2514e406d81f2e0eb8707d495'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:32.228860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709250c2514e406d81f2e0eb8707d495'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:32.229243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:32.243471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066d21a-9303-4799-a353-3ac0523a7ba0 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:32.243762 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de0a2145-1353-474a-96c5-27ee7e3101eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709250c2514e406d81f2e0eb8707d495'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:32.251127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:32.254663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:32.255443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:32.255764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:32.262556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:32.282458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:32.319689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 985/1964] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:31 2022] DELETE /identity/v3/users/709250c2514e406d81f2e0eb8707d495 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:32.324498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:32.324704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:32.325332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:32.351517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:32.354002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:32.370440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 980/1965] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:32.405956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:32.405956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:32.578087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:32.579422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 986/1966] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:32.579730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:32.659923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a117f-8027-45d6-9db8-70455e43140a service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:32.742624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:32.743269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:32.743630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:32.743957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:32.767189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:32.771049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:32.805739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 981/1967] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:33.391896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:33.394425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:33.419372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0582211-c107-49ba-8355-97aca85f0248 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:33.432589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:33.433677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:33.434133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:33.434482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] PATH_INFO: `/v3/projects/ec069050815c4c7e9297c504e68c600b` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:33.435971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec069050815c4c7e9297c504e68c600b)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:33.438153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:33.587123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec069050815c4c7e9297c504e68c600b', 'request_id': 'req-0deb77d6-5b75-4d2c-a741-a88e236dbee3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:33.598408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec069050815c4c7e9297c504e68c600b', 'request_id': 'req-0deb77d6-5b75-4d2c-a741-a88e236dbee3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:33.605761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec069050815c4c7e9297c504e68c600b', 'request_id': 'req-0deb77d6-5b75-4d2c-a741-a88e236dbee3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:33.716142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] The token cache is being invalidate because project ec069050815c4c7e9297c504e68c600b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:33.716519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:33.717161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:33.719313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 987/1968] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:33 2022] DELETE /identity/v3/projects/ec069050815c4c7e9297c504e68c600b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:33.723640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:33.734740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b0268-18bd-451d-94d3-9962c969a91d service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:33.795829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:33.796725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:33.797015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:33.797328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] PATH_INFO: `/v3/users/f8d78ec50b484c94b2faca220c5b0522` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:33.798650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d78ec50b484c94b2faca220c5b0522)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:33.800784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:33.939368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:34.038565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d78ec50b484c94b2faca220c5b0522'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.045510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d78ec50b484c94b2faca220c5b0522'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.046202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d78ec50b484c94b2faca220c5b0522'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.046814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d78ec50b484c94b2faca220c5b0522'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.139199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3fc2369e-3ed1-4eaa-89e3-b6b54de5da62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d78ec50b484c94b2faca220c5b0522'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.157611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 982/1969] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:33 2022] DELETE /identity/v3/users/f8d78ec50b484c94b2faca220c5b0522 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:34.655004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:34.656478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:34.672757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb77d6-5b75-4d2c-a741-a88e236dbee3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:34.735376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:34.736255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:34.736805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:34.738092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] PATH_INFO: `/v3/projects/391a91132a0348e196ebd33602833ccd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:34.739386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391a91132a0348e196ebd33602833ccd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:34.741361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:34.844003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391a91132a0348e196ebd33602833ccd', 'request_id': 'req-647644ec-1d54-4ce5-9910-46894bf5def2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.850358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391a91132a0348e196ebd33602833ccd', 'request_id': 'req-647644ec-1d54-4ce5-9910-46894bf5def2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.856848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391a91132a0348e196ebd33602833ccd', 'request_id': 'req-647644ec-1d54-4ce5-9910-46894bf5def2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.927085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] The token cache is being invalidate because project 391a91132a0348e196ebd33602833ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:34.927627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.928279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-647644ec-1d54-4ce5-9910-46894bf5def2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:34.930065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 988/1970] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:34 2022] DELETE /identity/v3/projects/391a91132a0348e196ebd33602833ccd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:34.935958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:34.936954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:34.936954 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:34.956341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:34.958548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:35.024335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 983/1971] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:35.032693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.032987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.033300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.043254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:35.055088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:35.056456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:35.064964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 989/1972] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:35.070233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.081000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fb397-71f5-4dcd-8a63-615eb2255ade None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.087119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.087817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.088110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.088394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.089152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:35.089507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.091165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.104931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 984/1973] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:35.109204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.119556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ac029-dc80-4751-ab45-76e7e48d8b63 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.124320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.124989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.125299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.125607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.126323 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.128474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.240355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 990/1974] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:35 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:35.242929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.253093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b828a-728b-4c70-a14b-8495a3bf2075 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.312664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.313415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.313711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.316909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.316909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.316909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.386123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 985/1975] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:35 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:35.390421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.401069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9b50-1dc9-49e9-bb5d-24da2bfa7545 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.405825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.406496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.406788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.407074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.408720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.409436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.420291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 991/1976] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:35.424473 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.435250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391fd85-000f-4faf-97cd-7ac2ad07c4e8 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.439956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d3d6-b0e5-469a-8274-c422cf8c63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.440703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d3d6-b0e5-469a-8274-c422cf8c63d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.440962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d3d6-b0e5-469a-8274-c422cf8c63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.441252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d3d6-b0e5-469a-8274-c422cf8c63d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.442663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d3d6-b0e5-469a-8274-c422cf8c63d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.444336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d3d6-b0e5-469a-8274-c422cf8c63d9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.454666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 986/1977] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:35.458910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.469257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8a80-e31a-4cd8-bedf-9fc32a49a5f9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.474124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.475007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.475296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.475584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] PATH_INFO: `/v3/projects/e711f54570b24ac883c7d98f89c19186/users/a36199637b5245ec9bb634ce0e86574e/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.494900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e711f54570b24ac883c7d98f89c19186, user_id=a36199637b5245ec9bb634ce0e86574e, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.498791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.585822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 992/1978] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:35 2022] PUT /identity/v3/projects/e711f54570b24ac883c7d98f89c19186/users/a36199637b5245ec9bb634ce0e86574e/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:35.597452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.597839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.599109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.630322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] MFA Rules not processed for user `a36199637b5245ec9bb634ce0e86574e`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:35.631991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:35.705065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 987/1979] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:35.716495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:35.718309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:35.762372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:35.787326 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c47ed-b5db-4793-943a-8dc7e0f6c6c3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:35.792249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:35.792915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:35.793199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:35.793508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:35.808830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:35.808830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:35.819137 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 993/1980] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:35.979588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:37.037524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:37.724395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:37.859906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:38.430922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:39.603049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:39.971194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:41.394831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:41.396598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:41.456091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f10ede-246e-4ea7-b448-1a0c5e1f2c48 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:41.460143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:41.460797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:41.461080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:41.461397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:41.463155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:41.526439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:41.527902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4d979-3154-48a6-9cae-2ddde8d47051 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:41.538484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 988/1981] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:41.860095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:42.243599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:43.460475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:43.665353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:43.666798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:43.739078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de852-2512-4660-97d2-e581c0d9457e service glance] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:43.742365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:43.746918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:43.746918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:43.746918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:43.746918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] PATH_INFO: `/v3/users/9f99b5e9482642939f8b9edec6c89ddc` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:43.748224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f99b5e9482642939f8b9edec6c89ddc)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:43.750232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:44.041935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f99b5e9482642939f8b9edec6c89ddc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:44.049353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f99b5e9482642939f8b9edec6c89ddc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:44.050157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f99b5e9482642939f8b9edec6c89ddc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:44.050809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f99b5e9482642939f8b9edec6c89ddc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:44.064050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f99b5e9482642939f8b9edec6c89ddc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:44.202895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 994/1982] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:43 2022] DELETE /identity/v3/users/9f99b5e9482642939f8b9edec6c89ddc => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:44.207549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:44.207857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:44.208145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:44.230054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:44.232302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:44.292681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 989/1983] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:44.302730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:44.305078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:44.365989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f847-8aef-46b0-9d98-e627f45da06e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:44.372472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:44.373157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:44.373481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:44.373895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:44.383823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:44.386901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:44.395267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 995/1984] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:44.921920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:44.923500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:44.947580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea363715-d3b7-4a9c-8e8e-b72fcda00d29 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:44.954170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:44.955450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:44.956442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:44.957222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] PATH_INFO: `/v3/projects/9336a6bf654246f88de45d31e0a509bb` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:44.959740 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9336a6bf654246f88de45d31e0a509bb)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:44.964567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:45.015386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:45.113813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9336a6bf654246f88de45d31e0a509bb', 'request_id': 'req-712a4542-3510-47fd-8210-76e27f56eadf'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.214557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9336a6bf654246f88de45d31e0a509bb', 'request_id': 'req-712a4542-3510-47fd-8210-76e27f56eadf'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.221953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9336a6bf654246f88de45d31e0a509bb', 'request_id': 'req-712a4542-3510-47fd-8210-76e27f56eadf'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.236798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] The token cache is being invalidate because project 9336a6bf654246f88de45d31e0a509bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:45.237101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.237796 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.239623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 990/1985] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:44 2022] DELETE /identity/v3/projects/9336a6bf654246f88de45d31e0a509bb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:45.244024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:45.266127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba3206-b845-4da0-9d70-d005df142bc9 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:45.334190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:45.337580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:45.337580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:45.337580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] PATH_INFO: `/v3/users/3367331a3c6a47cdaa2530e36aa6593e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:45.337580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3367331a3c6a47cdaa2530e36aa6593e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:45.339541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:45.600697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3367331a3c6a47cdaa2530e36aa6593e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.616147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3367331a3c6a47cdaa2530e36aa6593e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.617676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3367331a3c6a47cdaa2530e36aa6593e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.618431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3367331a3c6a47cdaa2530e36aa6593e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.631525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3367331a3c6a47cdaa2530e36aa6593e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:45.719156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:45.725570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 996/1986] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:45 2022] DELETE /identity/v3/users/3367331a3c6a47cdaa2530e36aa6593e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:46.520704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:46.522258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:46.535238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a4542-3510-47fd-8210-76e27f56eadf admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:46.607107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:46.608095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:46.608383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:46.608660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] PATH_INFO: `/v3/users/a4e2096f64544c2ba6c7e53a5ce8bb9d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:46.610373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e2096f64544c2ba6c7e53a5ce8bb9d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:46.613169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:46.617707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:46.619684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:46.634524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94207678-2bac-4174-a99a-bc14a307f55b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:46.639932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:46.641141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:46.641502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:46.641786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] PATH_INFO: `/v3/projects/f3487df9b0f242b6a407c1a72ffde71e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:46.643123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3487df9b0f242b6a407c1a72ffde71e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:46.645101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:46.889980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3487df9b0f242b6a407c1a72ffde71e', 'request_id': 'req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:46.895980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e2096f64544c2ba6c7e53a5ce8bb9d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:46.896695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3487df9b0f242b6a407c1a72ffde71e', 'request_id': 'req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:46.904273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3487df9b0f242b6a407c1a72ffde71e', 'request_id': 'req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:46.907732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e2096f64544c2ba6c7e53a5ce8bb9d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:46.909886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e2096f64544c2ba6c7e53a5ce8bb9d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:46.915907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e2096f64544c2ba6c7e53a5ce8bb9d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.009286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] The token cache is being invalidate because project f3487df9b0f242b6a407c1a72ffde71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:47.009646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.010450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.012007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 997/1987] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:46 2022] DELETE /identity/v3/projects/f3487df9b0f242b6a407c1a72ffde71e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:47.012885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.014325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.068501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-58875a38-8a21-4198-bacb-d3a87339501e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e2096f64544c2ba6c7e53a5ce8bb9d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.087850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2ecd-ee22-4292-96ad-119e4dfce8b9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.092673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.095504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.095504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.095504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] PATH_INFO: `/v3/users/6146910470cb4aea904436671dd3de01` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.095504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6146910470cb4aea904436671dd3de01)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.096239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 991/1988] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:46 2022] DELETE /identity/v3/users/a4e2096f64544c2ba6c7e53a5ce8bb9d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:47.097691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655c81-230b-4920-9ecd-c56256e51f52 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.097991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655c81-230b-4920-9ecd-c56256e51f52 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.098280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655c81-230b-4920-9ecd-c56256e51f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.099769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.118716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d5655c81-230b-4920-9ecd-c56256e51f52 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:47.119921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d5655c81-230b-4920-9ecd-c56256e51f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.147673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:47.184973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 992/1989] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:47.186339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b706-45b0-4d36-b70d-4f6b51b43137 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.186634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b706-45b0-4d36-b70d-4f6b51b43137 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.186921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b706-45b0-4d36-b70d-4f6b51b43137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.203869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1880b706-45b0-4d36-b70d-4f6b51b43137 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:47.205073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1880b706-45b0-4d36-b70d-4f6b51b43137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.213892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 993/1990] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:47.215090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.215381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.215666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.234166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:47.234547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:47.235376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.243716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 994/1991] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:47.244495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.245768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.304078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90042cad-8688-49b7-b3a9-c7457e93f0c4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.308226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.308877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.309162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.309483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.319441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.321021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.330861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 995/1992] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:47.331584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.340501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6146910470cb4aea904436671dd3de01'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.343675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76dde1-8e0b-4a63-a22f-9769efe6e7be service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.348645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6146910470cb4aea904436671dd3de01'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.349692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6146910470cb4aea904436671dd3de01'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.349839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.350159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6146910470cb4aea904436671dd3de01'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.350286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.350514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.350739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.352843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:47.353161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.354812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.364060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6146910470cb4aea904436671dd3de01'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:47.368354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 996/1993] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:47.372636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.374493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.388521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35fd0e-a809-4fc6-866f-fbd6019b3895 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.393355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.394067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.394357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.394688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.395491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.397413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.450641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 998/1994] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:47 2022] DELETE /identity/v3/users/6146910470cb4aea904436671dd3de01 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:47.534715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 997/1995] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:47 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:47.537745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.610070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc64aaa-961b-43c2-9e25-5ed0d551a201 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.674237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.675052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.675367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.675725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.676666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.679105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.838051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 999/1996] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:47 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:47.839635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.851141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7482-3de8-4890-9fab-40fffbd00293 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.856246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.856924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.857212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.857546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.858282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.860023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.870986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 998/1997] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:47.875311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.880624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.883378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.897358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae80ad-7702-413d-b4ee-79a3029cc760 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.904247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.905296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.905734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.906265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.907222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.908894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.913483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27aefc-35be-4aca-ba5e-e8d3fba5d360 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.923963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1000/1998] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:49:47.924570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.924911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:47.925653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.925982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.926269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] PATH_INFO: `/v3/projects/fd53f42710864254b5089064e629cfc5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.927555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd53f42710864254b5089064e629cfc5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.929911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:47.930411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:47.946389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515f0ea-243b-466a-8530-02d78c18fe71 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:47.952539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:47.974463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:47.974463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:47.974463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] PATH_INFO: `/v3/projects/0310b6f6eec44ea08aab4c40b50bddc3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:47.974463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0310b6f6eec44ea08aab4c40b50bddc3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:47.974463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:48.147522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd53f42710864254b5089064e629cfc5', 'request_id': 'req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.153552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0310b6f6eec44ea08aab4c40b50bddc3', 'request_id': 'req-eb2ba91c-ae3c-466d-83f7-0843671b9954'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.159206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0310b6f6eec44ea08aab4c40b50bddc3', 'request_id': 'req-eb2ba91c-ae3c-466d-83f7-0843671b9954'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.166211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0310b6f6eec44ea08aab4c40b50bddc3', 'request_id': 'req-eb2ba91c-ae3c-466d-83f7-0843671b9954'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.336647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd53f42710864254b5089064e629cfc5', 'request_id': 'req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.342973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd53f42710864254b5089064e629cfc5', 'request_id': 'req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.356944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] The token cache is being invalidate because project fd53f42710864254b5089064e629cfc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:48.357169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.357878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.359459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 999/1999] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:47 2022] DELETE /identity/v3/projects/fd53f42710864254b5089064e629cfc5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:48.360205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:48.361519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:48.426783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831ce7-8ee1-41ec-bc5d-8a10b7d225ba admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:48.486966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:48.487895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:48.488160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:48.488445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] PATH_INFO: `/v3/projects/f77a93e2c3424273b0193fffaa017623/users/be2a062586ac421a8e88e632bebbd944/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:48.489611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] The token cache is being invalidate because project 0310b6f6eec44ea08aab4c40b50bddc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:48.489980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.490797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.492789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1001/2000] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:47 2022] DELETE /identity/v3/projects/0310b6f6eec44ea08aab4c40b50bddc3 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:48.493535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:48.494925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:48.503485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a93e2c3424273b0193fffaa017623, user_id=be2a062586ac421a8e88e632bebbd944, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:48.506210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:48.508170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ba91c-ae3c-466d-83f7-0843671b9954 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:48.514223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:48.515108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:48.515400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:48.515683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] PATH_INFO: `/v3/users/47d11ca8f32b4f349e7366dffe49f019` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:48.516968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d11ca8f32b4f349e7366dffe49f019)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:48.518892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:48.647646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1000/2001] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:48 2022] PUT /identity/v3/projects/f77a93e2c3424273b0193fffaa017623/users/be2a062586ac421a8e88e632bebbd944/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:48.647646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:48.647646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:48.719576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234862c5-bd1c-4638-b682-1abf76876be2 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:48.724090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:48.727078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:48.727609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:48.727961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:48.728371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] PATH_INFO: `/v3/users/8b5838cb5263477f9a9889be7a48c746` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:48.729632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5838cb5263477f9a9889be7a48c746)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:48.731552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:48.771933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d11ca8f32b4f349e7366dffe49f019'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.779898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d11ca8f32b4f349e7366dffe49f019'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.784863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d11ca8f32b4f349e7366dffe49f019'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.784863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d11ca8f32b4f349e7366dffe49f019'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.798506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a6a72d38-673e-4a2e-ac90-774d37bd3cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d11ca8f32b4f349e7366dffe49f019'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.902645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1002/2002] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:48 2022] DELETE /identity/v3/users/47d11ca8f32b4f349e7366dffe49f019 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:48.904133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:48.904429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:48.904717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:48.936488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5838cb5263477f9a9889be7a48c746'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.936739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] MFA Rules not processed for user `be2a062586ac421a8e88e632bebbd944`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:48.937878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:48.943989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5838cb5263477f9a9889be7a48c746'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.944680 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5838cb5263477f9a9889be7a48c746'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:48.945352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5838cb5263477f9a9889be7a48c746'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.010654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1003/2003] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:49.016540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.016540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.021202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5838cb5263477f9a9889be7a48c746'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.041478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1001/2004] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:48 2022] DELETE /identity/v3/users/8b5838cb5263477f9a9889be7a48c746 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:49.089788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9620ef-e496-4287-b7c9-e120c72ea38e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.160783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.161419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.161887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.161887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.163001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:49.165218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:49.332578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1004/2005] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:49 2022] POST /identity/v3/projects => generated 363 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:49.334140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.345356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ee60c-6502-45a0-80b8-140bbbc0e03f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.394169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.396902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.436336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.437082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.437520 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.437922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.443294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:49.446170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:49.495953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937832-a120-4c5b-95da-e2b9622657a6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.501523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.502412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.502699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.503129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] PATH_INFO: `/v3/projects/78f367fbdec64d559c9550686cbcab9a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.504354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f367fbdec64d559c9550686cbcab9a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:49.506413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:49.559761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1002/2006] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:49 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:49.560743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.563738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.576707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7181821-1841-4e6b-9a26-106898c878fe admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.581779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.582647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.582936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.583220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] PATH_INFO: `/v3/projects/63d6f35224284ef29d22794a1cb91d0c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.584444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d6f35224284ef29d22794a1cb91d0c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:49.586554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:49.646296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f367fbdec64d559c9550686cbcab9a', 'request_id': 'req-78406e05-ddfa-4452-8e59-00c3cafebae5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.653385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f367fbdec64d559c9550686cbcab9a', 'request_id': 'req-78406e05-ddfa-4452-8e59-00c3cafebae5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.659799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f367fbdec64d559c9550686cbcab9a', 'request_id': 'req-78406e05-ddfa-4452-8e59-00c3cafebae5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.750250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d6f35224284ef29d22794a1cb91d0c', 'request_id': 'req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.771720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:49.778057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] The token cache is being invalidate because project 78f367fbdec64d559c9550686cbcab9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:49.778692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.779077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.780776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1005/2007] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:49 2022] DELETE /identity/v3/projects/78f367fbdec64d559c9550686cbcab9a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:49.784937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.787332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.870727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406e05-ddfa-4452-8e59-00c3cafebae5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.895014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d6f35224284ef29d22794a1cb91d0c', 'request_id': 'req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.903274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d6f35224284ef29d22794a1cb91d0c', 'request_id': 'req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.920110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] The token cache is being invalidate because project 63d6f35224284ef29d22794a1cb91d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:49.920412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.921099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3cacc871-be31-4bad-9c3d-95c4d6afd1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:49.924584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1003/2008] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:49 2022] DELETE /identity/v3/projects/63d6f35224284ef29d22794a1cb91d0c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:49.925552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.925878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.926169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.936324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.937011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.937405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.937695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.938439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:49.940142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:49.946075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:49.947221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.954266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1006/2009] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:49.955125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.956782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.959688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1004/2010] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:49.961111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:49.963036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:49.976082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63292671-c555-4c2b-8442-5fd9a87def3e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.980460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9cf58-3e81-4b55-808c-f96a5e58cda3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:49.982265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.983180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.985654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.985654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] PATH_INFO: `/v3/users/be84fa0b8f3c4453af7420a527d3a62b` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.985654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be84fa0b8f3c4453af7420a527d3a62b)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:49.985998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a4d8-105d-496a-aad4-6334e957b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:49.986423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a4d8-105d-496a-aad4-6334e957b28c admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:49.986706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a4d8-105d-496a-aad4-6334e957b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:49.986995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a4d8-105d-496a-aad4-6334e957b28c admin admin] PATH_INFO: `/v3/projects/54ec8c2182d9445b880742d9c799ca27/users/8b88ee138abe4c72b943e3c45b426c8d/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:49.987604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.003879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19a4d8-105d-496a-aad4-6334e957b28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec8c2182d9445b880742d9c799ca27, user_id=8b88ee138abe4c72b943e3c45b426c8d, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.006992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19a4d8-105d-496a-aad4-6334e957b28c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.182631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1005/2011] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:49 2022] PUT /identity/v3/projects/54ec8c2182d9445b880742d9c799ca27/users/8b88ee138abe4c72b943e3c45b426c8d/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:50.183944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.184240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.184526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.207958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:50.207958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:50.349835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1006/2012] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:50.350816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:50.362060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c05c7-033d-4fa1-be99-4399b53fc7d9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:50.366891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:50.368061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.368438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.368668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.369394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.370623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be84fa0b8f3c4453af7420a527d3a62b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:50.371041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.377975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be84fa0b8f3c4453af7420a527d3a62b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:50.378924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be84fa0b8f3c4453af7420a527d3a62b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:50.388252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1007/2013] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:50.388252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:50.389477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be84fa0b8f3c4453af7420a527d3a62b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:50.403243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc1a04-5115-4c46-a4b6-b3a1a6900233 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:50.409718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:50.410402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.410692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.410976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.411730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:50.412026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.412825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-0bca2e9d-c1de-40b7-95f1-4bc92b33a92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be84fa0b8f3c4453af7420a527d3a62b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:50.413772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.429051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1008/2014] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:50.429051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:50.430955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:50.445496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff94cc-11ab-4b75-b31c-32dde84838f9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:50.451440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4448-8788-4824-84af-99b42719805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:50.452375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4448-8788-4824-84af-99b42719805d admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.452727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4448-8788-4824-84af-99b42719805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.453016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4448-8788-4824-84af-99b42719805d admin admin] PATH_INFO: `/v3/projects/54ec8c2182d9445b880742d9c799ca27/users/8b88ee138abe4c72b943e3c45b426c8d/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.455085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4448-8788-4824-84af-99b42719805d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec8c2182d9445b880742d9c799ca27, user_id=8b88ee138abe4c72b943e3c45b426c8d, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.458089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4448-8788-4824-84af-99b42719805d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.469771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1009/2015] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:50 2022] PUT /identity/v3/projects/54ec8c2182d9445b880742d9c799ca27/users/8b88ee138abe4c72b943e3c45b426c8d/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:50.470741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4448-8788-4824-84af-99b42719805d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:50.473421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-51db4448-8788-4824-84af-99b42719805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:50.518062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1007/2016] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:49 2022] DELETE /identity/v3/users/be84fa0b8f3c4453af7420a527d3a62b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:50.519732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.520028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.520527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.561486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4448-8788-4824-84af-99b42719805d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:50.614865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] MFA Rules not processed for user `8b88ee138abe4c72b943e3c45b426c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:50.616393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:50.639775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:50.640638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.640937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.641228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.643207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.643955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.722527 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1008/2017] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:50.735917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:50.737754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:50.797560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1010/2018] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:50 2022] POST /identity/v3/projects => generated 375 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:50.800753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:50.840218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a823-c32b-413b-b641-1debbddc7126 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:50.885187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065f77-2c16-4689-b5a5-f6d8d1ac4441 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:50.895564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:50.896263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.897329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.897329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.897558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.900392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.903798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:50.904532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:50.905013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:50.905518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:50.975715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:50.977450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:50.988674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1009/2019] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:51.005521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1011/2020] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:50 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:51.010588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.021891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e0c1d-04a4-45f4-90d5-1c943401464d service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.027831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.028535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.028835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.029137 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.029934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.031799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.045166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1010/2021] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:51.063933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.076001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d354-414f-4b8b-9074-7e6a06249b43 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.080900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1bca-0a04-4cda-b985-810ab3ca7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.081704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1bca-0a04-4cda-b985-810ab3ca7250 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.082064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1bca-0a04-4cda-b985-810ab3ca7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.082413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1bca-0a04-4cda-b985-810ab3ca7250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.083380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1bca-0a04-4cda-b985-810ab3ca7250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.085076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1bca-0a04-4cda-b985-810ab3ca7250 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.096385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1012/2022] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:51.100902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.112655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40547a0d-2c7a-49d9-b61a-a71e98e5e624 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.118804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.120020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.120437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.120715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] PATH_INFO: `/v3/projects/f4f5292930144c0dbc321ccd3f3b3181/users/e14576bad67b4b01a570d2c40bd8003b/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.140715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f5292930144c0dbc321ccd3f3b3181, user_id=e14576bad67b4b01a570d2c40bd8003b, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.143909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.310378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1011/2023] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:51 2022] PUT /identity/v3/projects/f4f5292930144c0dbc321ccd3f3b3181/users/e14576bad67b4b01a570d2c40bd8003b/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:51.320987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.322055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.322176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.356872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.362676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] MFA Rules not processed for user `e14576bad67b4b01a570d2c40bd8003b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:51.364209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:51.416218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f334b-57b0-4778-adb0-7b321a457702 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.420266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.421027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.421413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.421760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.423763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:51.448333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1013/2024] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:51.451821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:51.453592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.495574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.497911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.503788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:51.510713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1012/2025] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:51.511395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.512688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:51.537310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f6ce3-1ca6-418a-9156-c7d96c9e3986 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.543910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.544593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.544887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.545170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.545984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.548265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.593939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3e71-76b6-4bd2-8cd6-1cc0c218afd0 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.599158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.600132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.600422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.600845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] PATH_INFO: `/v3/projects/ec36863f4fc54c14b951e9769547815e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.603135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec36863f4fc54c14b951e9769547815e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.605355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.669437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1014/2026] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:51 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:51.673430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.735179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec36863f4fc54c14b951e9769547815e', 'request_id': 'req-e1554388-943e-418d-961f-9849ff368984'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:51.741652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec36863f4fc54c14b951e9769547815e', 'request_id': 'req-e1554388-943e-418d-961f-9849ff368984'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:51.743530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d022b-07ad-48c5-b2e4-4e409d25a6d7 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.749221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec36863f4fc54c14b951e9769547815e', 'request_id': 'req-e1554388-943e-418d-961f-9849ff368984'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:51.806197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.806894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.807183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.807461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.808173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.811282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.828197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] The token cache is being invalidate because project ec36863f4fc54c14b951e9769547815e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:51.829122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:51.829856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e1554388-943e-418d-961f-9849ff368984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:51.834910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1013/2027] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:51 2022] DELETE /identity/v3/projects/ec36863f4fc54c14b951e9769547815e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:51.839402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040d326-dc50-4f5e-b47d-0ba7c7491dee None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.839734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040d326-dc50-4f5e-b47d-0ba7c7491dee None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.840024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040d326-dc50-4f5e-b47d-0ba7c7491dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.864651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f040d326-dc50-4f5e-b47d-0ba7c7491dee None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:51.866329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f040d326-dc50-4f5e-b47d-0ba7c7491dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:51.888831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1014/2028] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:51.890707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.891005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.891327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.927395 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1015/2029] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:51 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:51.931631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.932496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:51.933398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:51.933897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:51.953602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1015/2030] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:51.962203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.962558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163353-9365-4271-9092-4d245e5fa53c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.969182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.970054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.970213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697bb16-c112-4697-a306-c2bcc648df21 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:51.970716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.971218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.972443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.974888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.976274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:51.977737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:51.978025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:51.978307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:51.979114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:51.979440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:51.981464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:51.997318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1016/2032] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:51.997516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1016/2032] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:51.998903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:51.999898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.014210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa446f8-adf0-4670-94d3-5c750905c71d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.018298 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f061c-dfb3-4bb2-a6fe-3aaa61e4bab8 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.022726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.024219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.024765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.025202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.026217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.027977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.030046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0ec52-c544-43f1-b790-d67eec9a445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.030847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ec52-c544-43f1-b790-d67eec9a445b admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.031323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ec52-c544-43f1-b790-d67eec9a445b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.031814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ec52-c544-43f1-b790-d67eec9a445b admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.032729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0ec52-c544-43f1-b790-d67eec9a445b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.034876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0ec52-c544-43f1-b790-d67eec9a445b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.052256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1017/2033] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:52.053440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.064813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10a28d-1911-4250-ad1f-ff635e6aca7b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.070204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.071493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.071942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.072320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] PATH_INFO: `/v3/projects/419a02da1d7d432c84c90259987ce465/users/78d16aeffbbf464fb444c1b2e6526dae/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.091908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=419a02da1d7d432c84c90259987ce465, user_id=78d16aeffbbf464fb444c1b2e6526dae, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.094714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.188641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1018/2034] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:52 2022] PUT /identity/v3/projects/419a02da1d7d432c84c90259987ce465/users/78d16aeffbbf464fb444c1b2e6526dae/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:52.193728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1017/2035] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:51 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:52.200737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.201875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.202732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.203019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.246262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] MFA Rules not processed for user `78d16aeffbbf464fb444c1b2e6526dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:52.247668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:52.310882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95d7f3-7217-4e75-b414-30a547bfe1ac admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.360261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1018/2036] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:52.363786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.394964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.395629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.395923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.396201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.397021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.400940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.459691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a62ce-bcaf-4844-9734-2073dce320b3 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.466918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.467600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.467887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.468647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.468855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.470914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.511959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:52.513212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1019/2037] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:52 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:52.514082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.524341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c333994-3cb0-4f3e-a505-63970f8c4f6c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.529259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.529875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.530156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.530433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.531156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.532819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.545321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1020/2038] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:52.548483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.559619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40897879-4f58-4d88-a591-473a55632558 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.564814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.565630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.565921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.566209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.567003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.568628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.581232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1021/2039] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:52.585104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.596173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93676-173c-4cd5-a27f-441178c39d17 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.600967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f735-4d17-4bf3-9a03-a46459936e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.601976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f735-4d17-4bf3-9a03-a46459936e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.602202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f735-4d17-4bf3-9a03-a46459936e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.602480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f735-4d17-4bf3-9a03-a46459936e45 admin admin] PATH_INFO: `/v3/projects/5f0d5d28c1b043f4ad0be49c8eaa8264/users/9d4c2307eb844521bae09bd72069baab/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.617846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1019/2040] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:52 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:52.622499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.624006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f735-4d17-4bf3-9a03-a46459936e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0d5d28c1b043f4ad0be49c8eaa8264, user_id=9d4c2307eb844521bae09bd72069baab, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.626905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f735-4d17-4bf3-9a03-a46459936e45 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.694663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622dc4-d582-44c6-93e7-c9201a5b0ef7 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.701430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.702432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.702869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.703156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.703861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.705857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.718654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1022/2041] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:52 2022] PUT /identity/v3/projects/5f0d5d28c1b043f4ad0be49c8eaa8264/users/9d4c2307eb844521bae09bd72069baab/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:52.730917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.731265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.731544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.757944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] MFA Rules not processed for user `9d4c2307eb844521bae09bd72069baab`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:52.759233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:52.802523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1020/2042] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:52 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:52.807470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.826910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a107e-dc77-42b9-b155-568c6d06d703 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.866805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1023/2043] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:52.867981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.890643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:52.901913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.902645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.902940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.903724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.904944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.907173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.926799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1021/2044] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:52.928820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:52.940936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92115bbc-b858-4796-bf02-457c1420eaef admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.947117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.958973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.958973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.958973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] PATH_INFO: `/v3/projects/e03c64adbf414230b459aa49560aa26d/users/bff47d880f9042fa978752eaff8a0e32/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.960697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3647a1-5a09-4c71-9d82-24658806ad5f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:52.971187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03c64adbf414230b459aa49560aa26d, user_id=bff47d880f9042fa978752eaff8a0e32, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.974679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:52.979081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:52.979987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:52.980505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:52.980808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:52.983055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:52.985145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.128066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1022/2045] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:52 2022] PUT /identity/v3/projects/e03c64adbf414230b459aa49560aa26d/users/bff47d880f9042fa978752eaff8a0e32/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:53.128259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1024/2046] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:52 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:53.129216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.130994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.200724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249ea7-fca3-44be-8bce-84083daeba20 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.207836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.207836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.207836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.207836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.208177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.209695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.217406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90bf1e-524f-4193-b4d0-bfdc3a782612 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.224694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1025/2047] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:53.225161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.225546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.226025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.226267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.233317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.233317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.233317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.235775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d5f51-0413-4559-9325-52ca1d66dfb0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.240486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c71030-c441-4161-b1d0-ff83c03d6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.241397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c71030-c441-4161-b1d0-ff83c03d6dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.241692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c71030-c441-4161-b1d0-ff83c03d6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.241977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c71030-c441-4161-b1d0-ff83c03d6dc7 admin admin] PATH_INFO: `/v3/projects/e03c64adbf414230b459aa49560aa26d/users/bff47d880f9042fa978752eaff8a0e32/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.244605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c71030-c441-4161-b1d0-ff83c03d6dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03c64adbf414230b459aa49560aa26d, user_id=bff47d880f9042fa978752eaff8a0e32, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.247417 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c71030-c441-4161-b1d0-ff83c03d6dc7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.259314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1026/2048] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:53 2022] PUT /identity/v3/projects/e03c64adbf414230b459aa49560aa26d/users/bff47d880f9042fa978752eaff8a0e32/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:53.269613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.269915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.270202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.297558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] MFA Rules not processed for user `bff47d880f9042fa978752eaff8a0e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:53.298794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:53.369335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1023/2049] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:53 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:53.371820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.381361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1027/2050] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:53.393545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.395472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:53.423669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23781c8-66f2-4521-969a-334ac991c1a0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.485425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a3c3f-4f93-4b37-9106-76ecdae9152d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.490095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.490858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.491263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.491641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.494687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:53.514070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.515503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.516866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.517326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.518554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.520398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.537769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1024/2051] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:53.542265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.564552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ebc8-5907-4832-ad7c-a44084cbbe2c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.569824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.579336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.579888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.580290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] PATH_INFO: `/v3/projects/deb45fe342b747b389eb62ae72468c60/users/fb0b94e2a201491f9f8628126fd54f83/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.590067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:53.606069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb45fe342b747b389eb62ae72468c60, user_id=fb0b94e2a201491f9f8628126fd54f83, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.606069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.628113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.629714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.640005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1028/2052] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:53.699188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1025/2053] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:53 2022] PUT /identity/v3/projects/deb45fe342b747b389eb62ae72468c60/users/fb0b94e2a201491f9f8628126fd54f83/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:53.699420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.708497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40843-d610-41f5-a7a2-0f0739fc39cd service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.778221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dae0e-61bc-4a79-9651-1d70dd7eaa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.778858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dae0e-61bc-4a79-9651-1d70dd7eaa71 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.779113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dae0e-61bc-4a79-9651-1d70dd7eaa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.779403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dae0e-61bc-4a79-9651-1d70dd7eaa71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.780153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dae0e-61bc-4a79-9651-1d70dd7eaa71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.781814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dae0e-61bc-4a79-9651-1d70dd7eaa71 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.796404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1029/2054] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:53.797672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:53.815674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486751f-ccfb-4275-aff4-f953623f2322 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:53.815674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:53.816346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.816346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.817255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] PATH_INFO: `/v3/projects/deb45fe342b747b389eb62ae72468c60/users/fb0b94e2a201491f9f8628126fd54f83/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.819087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb45fe342b747b389eb62ae72468c60, user_id=fb0b94e2a201491f9f8628126fd54f83, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:53.822334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:53.835381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1026/2055] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:53 2022] PUT /identity/v3/projects/deb45fe342b747b389eb62ae72468c60/users/fb0b94e2a201491f9f8628126fd54f83/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:53.848105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:53.848464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:53.849056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:53.890549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] MFA Rules not processed for user `fb0b94e2a201491f9f8628126fd54f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:53.892016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:53.979675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1030/2056] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:54.085533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:54.088212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:54.157529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6701-9645-4e28-849b-f6ad31aa246e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:54.161252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5cd1-e37e-4840-8b3c-0558fef3cbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:54.162009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5cd1-e37e-4840-8b3c-0558fef3cbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:54.162300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5cd1-e37e-4840-8b3c-0558fef3cbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:54.162611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5cd1-e37e-4840-8b3c-0558fef3cbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:54.172850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad5cd1-e37e-4840-8b3c-0558fef3cbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:54.174345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad5cd1-e37e-4840-8b3c-0558fef3cbd8 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:54.185167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1027/2057] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:54.397314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:54.833869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:54.911763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:54.979832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf4b28-364f-45c5-ab12-50bb103a8ddc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:54.984408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:54.985294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:54.985634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:54.985938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] PATH_INFO: `/v3/users/9d4c2307eb844521bae09bd72069baab` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:54.987167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4c2307eb844521bae09bd72069baab)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:54.989203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:55.215582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4c2307eb844521bae09bd72069baab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.223680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4c2307eb844521bae09bd72069baab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.224620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4c2307eb844521bae09bd72069baab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.225363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4c2307eb844521bae09bd72069baab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.241662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4c2307eb844521bae09bd72069baab'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.313617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1031/2058] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:54 2022] DELETE /identity/v3/users/9d4c2307eb844521bae09bd72069baab => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:55.318077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:55.318571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:55.318667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:55.335877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:55.337180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:55.386806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:55.389130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:55.406808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1028/2059] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:55.419944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:55.421518 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:55.459594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403168-3686-40e5-b5fb-f07c03664b92 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:55.464888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:55.465811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:55.466239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:55.466531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] PATH_INFO: `/v3/users/22950ef462df4f54a999200e183200c3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:55.467790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22950ef462df4f54a999200e183200c3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:55.469814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:55.481344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8ea6-9bec-4c58-b425-95808db8d0dd None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:55.485087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:55.485819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:55.486107 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:55.486392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:55.496233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:55.501850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:55.514699 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1029/2060] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:49:55.688074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:55.689573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:55.703763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a5ea5-fb20-405c-b507-fe0264bca753 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:55.710375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:55.711391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:55.712774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:55.713059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] PATH_INFO: `/v3/users/be2a062586ac421a8e88e632bebbd944` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:55.714662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2a062586ac421a8e88e632bebbd944)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:55.723142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:55.723284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22950ef462df4f54a999200e183200c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.728963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22950ef462df4f54a999200e183200c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.729901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22950ef462df4f54a999200e183200c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.730615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22950ef462df4f54a999200e183200c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.744229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22950ef462df4f54a999200e183200c3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.835202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1032/2061] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:55 2022] DELETE /identity/v3/users/22950ef462df4f54a999200e183200c3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:55.836122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:55.843279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:55.843511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:55.912568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c932f3-47ea-4c3c-9456-b6f6661bcaf2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:55.917633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:55.918324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:55.918611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:55.918908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:55.926505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:55.988229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2a062586ac421a8e88e632bebbd944'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:55.999201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2a062586ac421a8e88e632bebbd944'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.000336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2a062586ac421a8e88e632bebbd944'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.001870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2a062586ac421a8e88e632bebbd944'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.006671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.008402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.020840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1033/2062] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:56.021999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.023693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.098443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2a062586ac421a8e88e632bebbd944'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.103012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb9d1-610d-43b1-943a-832848917075 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:56.108131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:56.109205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.109523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.109805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] PATH_INFO: `/v3/projects/5f0d5d28c1b043f4ad0be49c8eaa8264` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.111087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0d5d28c1b043f4ad0be49c8eaa8264)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.113080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.127701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1030/2063] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:55 2022] DELETE /identity/v3/users/be2a062586ac421a8e88e632bebbd944 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:56.128661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.131246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.229904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48a75-31b6-41a3-9871-e06d5c6c3b42 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:56.235276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:56.236169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.236454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.236733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] PATH_INFO: `/v3/projects/8d951c7f7afd49b09b6045b09a9d98e0` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.237943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d951c7f7afd49b09b6045b09a9d98e0)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.240442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.329549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0d5d28c1b043f4ad0be49c8eaa8264', 'request_id': 'req-de7e9219-bdec-42ab-9302-f41756bc9759'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.335332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0d5d28c1b043f4ad0be49c8eaa8264', 'request_id': 'req-de7e9219-bdec-42ab-9302-f41756bc9759'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.341753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0d5d28c1b043f4ad0be49c8eaa8264', 'request_id': 'req-de7e9219-bdec-42ab-9302-f41756bc9759'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.365675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d951c7f7afd49b09b6045b09a9d98e0', 'request_id': 'req-572d68b9-8f68-4d88-86a5-60529b040da6'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.451614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] The token cache is being invalidate because project 5f0d5d28c1b043f4ad0be49c8eaa8264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:56.453113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.453600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:56.454300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-de7e9219-bdec-42ab-9302-f41756bc9759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.456033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1034/2064] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:56 2022] DELETE /identity/v3/projects/5f0d5d28c1b043f4ad0be49c8eaa8264 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:56.457477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.457764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.458045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.476965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:56.478843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.530472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d951c7f7afd49b09b6045b09a9d98e0', 'request_id': 'req-572d68b9-8f68-4d88-86a5-60529b040da6'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.537711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1035/2065] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:56.538623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d951c7f7afd49b09b6045b09a9d98e0', 'request_id': 'req-572d68b9-8f68-4d88-86a5-60529b040da6'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.538817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.540757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.554145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] The token cache is being invalidate because project 8d951c7f7afd49b09b6045b09a9d98e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:56.554455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.555044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b27bf-a97f-4ddd-86d0-1cf6c1ebce9a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:56.555166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.557704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1031/2066] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:56 2022] DELETE /identity/v3/projects/8d951c7f7afd49b09b6045b09a9d98e0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:56.561610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.562437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:56.562960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.563563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.563924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.564278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] PATH_INFO: `/v3/users/fb0b94e2a201491f9f8628126fd54f83` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.565659 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0b94e2a201491f9f8628126fd54f83)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.567671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.624663 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d68b9-8f68-4d88-86a5-60529b040da6 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:56.628538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:56.629239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.629560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.629872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.631667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.644499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.646048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6a44c-93c6-4948-b94e-b590f0df993a service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.655620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1032/2067] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:56.656879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114337ee-90e5-4675-abe7-1961dd5b5321 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.657175 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114337ee-90e5-4675-abe7-1961dd5b5321 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.657491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114337ee-90e5-4675-abe7-1961dd5b5321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.675888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-114337ee-90e5-4675-abe7-1961dd5b5321 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:56.677099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-114337ee-90e5-4675-abe7-1961dd5b5321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.687213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1033/2068] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:56.695014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.697389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.697684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.716172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:56.717450 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.726392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1034/2069] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:56.731145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.741002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31119-f9ea-4c93-a3fd-c99b4dcf03a9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:56.747509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:56.748201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.748540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.748827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.749702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:56.750034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.751693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.768167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1035/2070] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:49:56.769597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.770929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0b94e2a201491f9f8628126fd54f83'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.779151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0b94e2a201491f9f8628126fd54f83'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.779878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0b94e2a201491f9f8628126fd54f83'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.780019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44fa26-e731-4676-a7d3-caca7531afa9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:56.780601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0b94e2a201491f9f8628126fd54f83'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.785040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:56.785757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:56.786048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:56.786335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:56.787031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:56.788964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:56.794086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0b94e2a201491f9f8628126fd54f83'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:56.829481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:56.871162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1036/2071] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:56 2022] DELETE /identity/v3/users/fb0b94e2a201491f9f8628126fd54f83 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:56.893792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1036/2072] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:56 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:56.898459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:56.900254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:56.976714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17f9a-f596-4833-87e8-97a3d8fc98a7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.039283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.040034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.040924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.041195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.046898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.046898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.208238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1037/2073] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:56 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:57.212869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.225362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e4a5-d09d-496a-aac5-adc29655f2dd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.234537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.235224 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.235780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.235860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.236639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.238907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.255293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1037/2074] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:57.270473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.280969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:57.282386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.296462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4c00-13da-4220-a452-e87945992ad3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.307312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002a11-5792-48b6-b255-41533de13ce1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.308877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.310457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.310747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.311438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.312100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.312574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.313536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.313887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.314221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.314337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] PATH_INFO: `/v3/projects/f77a93e2c3424273b0193fffaa017623` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.316108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77a93e2c3424273b0193fffaa017623)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.318256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.328223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1038/2075] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:57.332199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.349876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f2c69-a37e-410a-a69e-435aa9bd50a1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.355765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.356802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.357169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.357541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] PATH_INFO: `/v3/projects/39ffd197683b49a4b8982c4bfdf03e3a/users/546a41305ada4e0eaf282823a355f4cb/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.374534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ffd197683b49a4b8982c4bfdf03e3a, user_id=546a41305ada4e0eaf282823a355f4cb, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.377338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.465481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1039/2076] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:57 2022] PUT /identity/v3/projects/39ffd197683b49a4b8982c4bfdf03e3a/users/546a41305ada4e0eaf282823a355f4cb/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:57.467416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.471810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:57.485169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77a93e2c3424273b0193fffaa017623', 'request_id': 'req-61662993-f334-4983-af01-b897ee4ca671'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.491409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77a93e2c3424273b0193fffaa017623', 'request_id': 'req-61662993-f334-4983-af01-b897ee4ca671'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.499794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77a93e2c3424273b0193fffaa017623', 'request_id': 'req-61662993-f334-4983-af01-b897ee4ca671'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.545747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b439889-df7c-4ee7-8d63-e420f856e244 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.607949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.608817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.609099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.609454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] PATH_INFO: `/v3/projects/deb45fe342b747b389eb62ae72468c60` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.609630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] The token cache is being invalidate because project f77a93e2c3424273b0193fffaa017623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:57.610009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.610656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb45fe342b747b389eb62ae72468c60)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.611905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-61662993-f334-4983-af01-b897ee4ca671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.613179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.615506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1038/2077] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:57 2022] DELETE /identity/v3/projects/f77a93e2c3424273b0193fffaa017623 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:57.619124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.620951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.621379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.660885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] MFA Rules not processed for user `546a41305ada4e0eaf282823a355f4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:57.662246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:57.742351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1039/2078] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:57.754997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.756448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:57.763037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb45fe342b747b389eb62ae72468c60', 'request_id': 'req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.771884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:57.783329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8943-cff0-43bb-a91e-ef6ab6fc5dd5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.788661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:57.816886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb45fe342b747b389eb62ae72468c60', 'request_id': 'req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.824843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb45fe342b747b389eb62ae72468c60', 'request_id': 'req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.836446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] The token cache is being invalidate because project deb45fe342b747b389eb62ae72468c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:57.836736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.838627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:57.841101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1040/2079] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:57 2022] DELETE /identity/v3/projects/deb45fe342b747b389eb62ae72468c60 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:57.845324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:57.846703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:57.853457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.855162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.856325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.856831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] PATH_INFO: `/v3/users/8b88ee138abe4c72b943e3c45b426c8d` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.858383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b88ee138abe4c72b943e3c45b426c8d)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:57.860396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:57.934992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3ba0b-dcd7-42f8-a1d1-d5f6d54c2597 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:57.940599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:57.941256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:57.941571 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:57.941857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:57.943774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.002653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.004322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.013504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1041/2080] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:58.014394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.015735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.088504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1057f26-5b52-451c-973e-8c958b10136b service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.091195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b88ee138abe4c72b943e3c45b426c8d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.093688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.100093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.100093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.100093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.100093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.100445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b88ee138abe4c72b943e3c45b426c8d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.100982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b88ee138abe4c72b943e3c45b426c8d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.101728 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b88ee138abe4c72b943e3c45b426c8d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.116080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b88ee138abe4c72b943e3c45b426c8d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.169022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.170643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011a9f6-31e6-41e5-a389-32c5d11a3158 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.181775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1042/2081] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:58.183262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc34f-a5c9-4006-9a9b-71a53583764c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.183535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc34f-a5c9-4006-9a9b-71a53583764c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.183893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc34f-a5c9-4006-9a9b-71a53583764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.203017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-73bcc34f-a5c9-4006-9a9b-71a53583764c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:58.204324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-73bcc34f-a5c9-4006-9a9b-71a53583764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.213790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1043/2082] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:58.226032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.226032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.226032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.232377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1040/2083] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:57 2022] DELETE /identity/v3/users/8b88ee138abe4c72b943e3c45b426c8d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:58.250801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:58.250801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.293717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.295464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.332321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1044/2084] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:58.337534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.348834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354205-8fd1-4fa4-bd30-6d086c33abcd None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.354521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.355181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.355475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.355760 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.356602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:58.356925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.358636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.371900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1045/2085] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:49:58.375907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.378493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819720c2-9047-4a65-9c8a-2ba263c95f2e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.383195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.384150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.384653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.385008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] PATH_INFO: `/v3/users/546a41305ada4e0eaf282823a355f4cb` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.385992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0456-0733-4409-887c-1481aeee847d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.386256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546a41305ada4e0eaf282823a355f4cb)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.388349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.390914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.391398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.391691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.391981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.392679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.394606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.516542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:58.521042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1046/2086] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:58 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:58.527174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.617804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546a41305ada4e0eaf282823a355f4cb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.619886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0012-00a9-47bd-82cb-62567481d7e5 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.625204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.625990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.626311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.626643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.627023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546a41305ada4e0eaf282823a355f4cb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.627432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.627816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546a41305ada4e0eaf282823a355f4cb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.628532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546a41305ada4e0eaf282823a355f4cb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.629437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.643329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eaf8e54c-91ff-4108-ab44-1fbf9e9cef99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546a41305ada4e0eaf282823a355f4cb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:58.784610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1047/2087] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:58 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:58.785686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.787202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1041/2088] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:49:58 2022] DELETE /identity/v3/users/546a41305ada4e0eaf282823a355f4cb => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:49:58.787327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.796540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.796838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.797126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.800970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677cf6-7f24-417d-a913-11c5fa1dcf4e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.816064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:58.817370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.859653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.860458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.860745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.861031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] PATH_INFO: `/v3/projects/54ec8c2182d9445b880742d9c799ca27` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.862278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ec8c2182d9445b880742d9c799ca27)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.865111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.883316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1042/2089] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:58.886287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.893700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.906286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aef30-afa0-4fe3-9ac2-2909e40e14cc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:58.910959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:58.911619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:58.911902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:58.912179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:58.912966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:58.914623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:58.924796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1043/2090] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:58.926996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:58.927366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:58.985946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5e284-2eab-4f96-8cfd-b60476786646 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.000885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ec8c2182d9445b880742d9c799ca27', 'request_id': 'req-4e8db08d-13a9-4fa6-a76d-4081791b31d4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.017332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:59.037836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.038502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.038797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.039086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.100532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.102011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.111544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1044/2091] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:49:59.112274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.121487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200594-e5f0-45bd-ab29-f15fec43c211 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.125756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ec8c2182d9445b880742d9c799ca27', 'request_id': 'req-4e8db08d-13a9-4fa6-a76d-4081791b31d4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.128254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.128935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.129154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.129556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.130519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.132297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.133533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ec8c2182d9445b880742d9c799ca27', 'request_id': 'req-4e8db08d-13a9-4fa6-a76d-4081791b31d4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.147940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1045/2092] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:59.150212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.151001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] The token cache is being invalidate because project 54ec8c2182d9445b880742d9c799ca27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:49:59.151001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.151714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-4e8db08d-13a9-4fa6-a76d-4081791b31d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.157572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1048/2093] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:58 2022] DELETE /identity/v3/projects/54ec8c2182d9445b880742d9c799ca27 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:59.159146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362590f-035b-4313-be35-5c17da1b3bba None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.159447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362590f-035b-4313-be35-5c17da1b3bba None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.159827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362590f-035b-4313-be35-5c17da1b3bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.160726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb30d-9339-42bb-8f55-306801911732 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.166074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768bcf-cd01-421f-90f5-5e19d24355cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.167040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768bcf-cd01-421f-90f5-5e19d24355cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.167332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768bcf-cd01-421f-90f5-5e19d24355cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.168280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768bcf-cd01-421f-90f5-5e19d24355cb admin admin] PATH_INFO: `/v3/projects/4cbf9af311814878a79921105b3dabc1/users/cce75b33610242b589b0b29266d04f0c/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.178679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1362590f-035b-4313-be35-5c17da1b3bba None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:59.179905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1362590f-035b-4313-be35-5c17da1b3bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:59.184643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768bcf-cd01-421f-90f5-5e19d24355cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbf9af311814878a79921105b3dabc1, user_id=cce75b33610242b589b0b29266d04f0c, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.187037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768bcf-cd01-421f-90f5-5e19d24355cb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.189159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1049/2094] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:59.197603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.198002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.198342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.217460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:59.218541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:59.219776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:59.228541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1050/2095] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:49:59.232719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.242394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d042e-9699-435b-8517-60c6a9d2a4e9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.247574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.248216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.248506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.248788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.249665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:49:59.249914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.251551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.264165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1051/2096] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:49:59.271425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.281805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6cf03-ef13-4fce-bbc5-b657ac18bc70 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.286353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1046/2097] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:49:59 2022] PUT /identity/v3/projects/4cbf9af311814878a79921105b3dabc1/users/cce75b33610242b589b0b29266d04f0c/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:49:59.307978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.308259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.308524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.347565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] MFA Rules not processed for user `cce75b33610242b589b0b29266d04f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:49:59.350522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:59.355080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.355754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.356239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.356451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.357164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.359234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.437558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1047/2098] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:49:59.442283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.444174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:59.463579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b07cf-28da-4547-a02c-cf9e43dc1b5e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.470838 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.471529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.473534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.473853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.474650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.477595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.497159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1052/2099] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:59.500892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.571160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04152-0b57-4bd2-9f8e-df866810b4b7 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.576669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.577461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.577976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.578269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.578972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.580888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.595611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1048/2100] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:49:59.597478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.703702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1053/2101] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:59.709646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.713347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:49:59.718905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d66cf-321c-4916-925d-4e4a7fa099f3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.723932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.724751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.725307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.725957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.726665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.729711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.729835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410da39-e17d-443d-829e-ca686a91e36b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.735169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.736241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.736470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.736647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] PATH_INFO: `/v3/projects/39ffd197683b49a4b8982c4bfdf03e3a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.738180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ffd197683b49a4b8982c4bfdf03e3a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.740388 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.846232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1049/2102] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:49:59 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:49:59.850487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.860773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b93da-b097-41b5-b23c-e66d3dff8dd5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.865896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.866561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.866851 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.867183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.867864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.870221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.880505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1050/2103] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:59.881295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.891885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59199d-1e4b-4cd5-98e6-ba6801abdebb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.907581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ffd197683b49a4b8982c4bfdf03e3a', 'request_id': 'req-7fbd2361-dda8-4cef-ac99-e2f423922f31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.951593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.952267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.952559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.953110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.953925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.955514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.967045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1051/2104] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:49:59.967969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:49:59.978980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce494-bff6-4535-a738-e5cfa4b00919 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:49:59.984783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:49:59.985576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:49:59.985871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:49:59.986157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:49:59.986996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:49:59.988526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ffd197683b49a4b8982c4bfdf03e3a', 'request_id': 'req-7fbd2361-dda8-4cef-ac99-e2f423922f31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:49:59.988646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:49:59.996005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ffd197683b49a4b8982c4bfdf03e3a', 'request_id': 'req-7fbd2361-dda8-4cef-ac99-e2f423922f31'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:00.000339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1052/2105] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:00.001140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.008313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] The token cache is being invalidate because project 39ffd197683b49a4b8982c4bfdf03e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:00.008620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:00.009416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:00.011068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1054/2106] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:49:59 2022] DELETE /identity/v3/projects/39ffd197683b49a4b8982c4bfdf03e3a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:00.011932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.013228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.013380 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d404a-42ee-4f28-9b9c-cd572e414ada admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.018384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57face2-9c18-4a24-9b67-9a7391881cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.019260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57face2-9c18-4a24-9b67-9a7391881cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.019550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57face2-9c18-4a24-9b67-9a7391881cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.019833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57face2-9c18-4a24-9b67-9a7391881cb6 admin admin] PATH_INFO: `/v3/projects/767aaa42d64c496285d19fa572e66cfa/users/51253ff5983c4b32955a8a5e5579d18e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.026464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd2361-dda8-4cef-ac99-e2f423922f31 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.031394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.032331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.032656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.032940 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] PATH_INFO: `/v3/projects/29bbeee2363d451bb307d1ab19569946/users/a1a6162c6db54678ab156f35cd4996eb/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.035094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57face2-9c18-4a24-9b67-9a7391881cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767aaa42d64c496285d19fa572e66cfa, user_id=51253ff5983c4b32955a8a5e5579d18e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.037906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57face2-9c18-4a24-9b67-9a7391881cb6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.049071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bbeee2363d451bb307d1ab19569946, user_id=a1a6162c6db54678ab156f35cd4996eb, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.052049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.123669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1053/2107] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:00 2022] PUT /identity/v3/projects/767aaa42d64c496285d19fa572e66cfa/users/51253ff5983c4b32955a8a5e5579d18e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:00.125442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793710e-4a23-4526-a786-4e1a4a964eea None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.125805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793710e-4a23-4526-a786-4e1a4a964eea None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.126193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793710e-4a23-4526-a786-4e1a4a964eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.147925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7793710e-4a23-4526-a786-4e1a4a964eea None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:00.149156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7793710e-4a23-4526-a786-4e1a4a964eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.172139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1055/2108] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:00 2022] PUT /identity/v3/projects/29bbeee2363d451bb307d1ab19569946/users/a1a6162c6db54678ab156f35cd4996eb/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:00.173163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.174845 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.219118 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1054/2109] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:00.220619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.220860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.221533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.242926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecc36b-f1c8-4f49-93d5-3c903d32194f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.249095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cf837-f4a9-4e3c-98f3-a47d4d500f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.249840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf837-f4a9-4e3c-98f3-a47d4d500f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.250134 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf837-f4a9-4e3c-98f3-a47d4d500f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.250421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cf837-f4a9-4e3c-98f3-a47d4d500f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.251160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cf837-f4a9-4e3c-98f3-a47d4d500f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.252967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cf837-f4a9-4e3c-98f3-a47d4d500f42 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.262805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] MFA Rules not processed for user `a1a6162c6db54678ab156f35cd4996eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:00.264601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.285829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1056/2110] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:00.288136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.288624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.289096 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.317050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:00.318323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.327467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1057/2111] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:00.328320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.337999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17c49-b7a9-47b8-acf1-21bd3a4bf6f0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.343116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.344022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.344296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.344572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] PATH_INFO: `/v3/projects/767aaa42d64c496285d19fa572e66cfa/users/51253ff5983c4b32955a8a5e5579d18e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.346516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] RBAC: Authorizing `identity:create_grant(project_id=767aaa42d64c496285d19fa572e66cfa, user_id=51253ff5983c4b32955a8a5e5579d18e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.349610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.356944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1055/2112] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:00.357844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.361048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1058/2113] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:00 2022] PUT /identity/v3/projects/767aaa42d64c496285d19fa572e66cfa/users/51253ff5983c4b32955a8a5e5579d18e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:00.368005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99397078-e7a8-467c-a54a-f9ec2283d7df None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.369185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.437577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.438271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.438587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.438991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.439143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421e13-3089-47d3-a7a7-86e5973d569c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.439739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:00.440060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.441861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a605fea-6ae1-464c-851f-fe6583307931 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.444193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.451597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.451597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.451597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.451597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.451597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.455602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1056/2114] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:00.456946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.457379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.457758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.483578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] MFA Rules not processed for user `51253ff5983c4b32955a8a5e5579d18e`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:00.484848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.546152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:00.552671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1059/2115] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:00.552874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1057/2116] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:00.558281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.558710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.569487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646fdc4-b798-4f6e-a2b6-cd0a11263c19 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.623155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b634-e15e-4e07-b8ce-183269ed15cf admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.628374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.629036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.629351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.629637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.630350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.632012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.632304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.632752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.633124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.633408 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.634017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.637252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.746257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:00.752828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1058/2117] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:00.752961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1060/2118] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:00.753053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.755129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:00.756139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.819373 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263af8-0040-4d01-a57b-2f42455dc4cb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.830222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbc079-5e77-4c47-ade0-e38b27c15d88 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.835481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.836282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.836647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.837102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.838037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.840174 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.872837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.873532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.873822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.874107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.940045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.941644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.951469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1059/2119] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:00.952654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.963702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5021bd-e9a5-4cbc-bea6-887b67f630c9 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.968874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.969729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.970027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.970309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.974751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:00.974751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:00.974937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1061/2120] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:00 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:00.978708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.985031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1060/2121] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:00.989195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:00.989707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68deec-c406-48e5-af33-938e898c8e0e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:00.996292 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:00.997064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:00.997389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:00.997678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:00.998423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.000143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.000441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609e2e-7fa2-4912-8011-48e3527ece93 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.007516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.008730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.008730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.008965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] PATH_INFO: `/v3/projects/83ea56c71a23484f9dfe59a3a36217d3/users/ac18edc7db564a26a0556de7d4cb32ca/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.013308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1062/2122] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:01.015762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.026519 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ea56c71a23484f9dfe59a3a36217d3, user_id=ac18edc7db564a26a0556de7d4cb32ca, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.026745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d9cf-80dc-4f32-8c47-ebfdf6baa822 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.030000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.031702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.032400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.032692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.032978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.033761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.035359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.047025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1063/2123] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:01.051173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.062811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ade1be-999e-4ad1-83a2-27c79134bbf3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.067644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.068547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.068839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.069122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] PATH_INFO: `/v3/projects/42a8d22c51544db5a5b683f069f1d279/users/06767dd8c35d49cc9594120c47f97db2/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.084475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a8d22c51544db5a5b683f069f1d279, user_id=06767dd8c35d49cc9594120c47f97db2, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.087176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.187824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1061/2124] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:00 2022] PUT /identity/v3/projects/83ea56c71a23484f9dfe59a3a36217d3/users/ac18edc7db564a26a0556de7d4cb32ca/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:01.192017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.219495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1064/2125] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:01 2022] PUT /identity/v3/projects/42a8d22c51544db5a5b683f069f1d279/users/06767dd8c35d49cc9594120c47f97db2/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:01.221830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.223742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.252930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a11b-3d71-4f0d-8129-8e1021d8c9d5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.315952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762b65-498d-4c70-9b62-6c9681dc59d1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.321130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.322542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.323232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.323529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] PATH_INFO: `/v3/users/a36199637b5245ec9bb634ce0e86574e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.324778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36199637b5245ec9bb634ce0e86574e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.326826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.330245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.330972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.331252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.342271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.342271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.392858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.394396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.404274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1062/2126] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:01.405302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.417998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ad9cd-2a60-408e-a9e2-19dac1b8dcfd service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.423088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cb79b-3092-484f-81b1-aa02e1f9fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.423776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cb79b-3092-484f-81b1-aa02e1f9fccb admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.424208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cb79b-3092-484f-81b1-aa02e1f9fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.425771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cb79b-3092-484f-81b1-aa02e1f9fccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.425771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cb79b-3092-484f-81b1-aa02e1f9fccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.427035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cb79b-3092-484f-81b1-aa02e1f9fccb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.438934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1063/2127] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:01.443429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.443429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.443429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.472863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] MFA Rules not processed for user `06767dd8c35d49cc9594120c47f97db2`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:01.474467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.532101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:01.544650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1064/2128] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:01.545433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.555873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730921e-7448-429c-8032-d133db7f06a1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.561334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.562219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.562501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.562782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] PATH_INFO: `/v3/projects/83ea56c71a23484f9dfe59a3a36217d3/users/ac18edc7db564a26a0556de7d4cb32ca/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.564768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ea56c71a23484f9dfe59a3a36217d3, user_id=ac18edc7db564a26a0556de7d4cb32ca, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.567480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.578850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1065/2129] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:01 2022] PUT /identity/v3/projects/83ea56c71a23484f9dfe59a3a36217d3/users/ac18edc7db564a26a0556de7d4cb32ca/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:01.584301 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.593575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36199637b5245ec9bb634ce0e86574e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:01.602165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36199637b5245ec9bb634ce0e86574e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:01.603052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36199637b5245ec9bb634ce0e86574e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:01.604378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36199637b5245ec9bb634ce0e86574e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:01.668793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b64f-37f6-4973-a91a-7a54df1523b5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.673995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943019a3-77bc-47eb-ba95-32f71224739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.674665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943019a3-77bc-47eb-ba95-32f71224739d admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.674954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943019a3-77bc-47eb-ba95-32f71224739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.675236 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943019a3-77bc-47eb-ba95-32f71224739d admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.675964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943019a3-77bc-47eb-ba95-32f71224739d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.677961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943019a3-77bc-47eb-ba95-32f71224739d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.731729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04e2c4fb-34fc-449d-8dbb-cbe0f513c101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36199637b5245ec9bb634ce0e86574e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:01.757924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1065/2130] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:01 2022] DELETE /identity/v3/users/a36199637b5245ec9bb634ce0e86574e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:01.757924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.757924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.757924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.786023 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] MFA Rules not processed for user `ac18edc7db564a26a0556de7d4cb32ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:01.787273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.833208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1066/2131] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:01 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:01.834662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.839794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.839794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.856406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:01.857753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.867649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1066/2132] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:01.869310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.870854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.920774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1067/2133] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:01.931781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:01.933751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:01.941708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0522fc-ee09-4092-9ae4-f5d5569b1268 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:01.947492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:01.948353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:01.948805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:01.949094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:01.949850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:01.952041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:01.994535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27897a-e401-499c-b59f-3a665b177ab7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.002992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.002992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.002992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.002992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.014133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.015621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.025882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1068/2134] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:02.026854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.031363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.102122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1067/2135] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:01 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:02.102122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.103622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.111072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb37975-7659-4976-89e3-265d70b22512 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.116317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.117634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.117926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.118209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.130950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31827a-15d2-449f-bf24-156af958aaeb admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.137123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.138126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.138479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.138775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] PATH_INFO: `/v3/users/cce75b33610242b589b0b29266d04f0c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.140121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce75b33610242b589b0b29266d04f0c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.142206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.197971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.199455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.208995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1069/2136] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:02.209811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.219846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454e27-481e-443d-a320-07ad8d67af79 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.225068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.225804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.226094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.226377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.227179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.229404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.240333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1070/2137] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:02.245317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.255425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223d4e6-9ddc-4bc0-9d5a-56dacb2d8d03 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.258866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:02.269146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.279000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.279113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.279382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] PATH_INFO: `/v3/projects/672f8c501ac745f1a44c3d38c7b19f0e/users/125cadacc2634c7d9afea73bb8b2eea2/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.298421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672f8c501ac745f1a44c3d38c7b19f0e, user_id=125cadacc2634c7d9afea73bb8b2eea2, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.301102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.374769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce75b33610242b589b0b29266d04f0c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.382246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce75b33610242b589b0b29266d04f0c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.382949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce75b33610242b589b0b29266d04f0c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.383579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce75b33610242b589b0b29266d04f0c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.435958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1071/2138] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:02 2022] PUT /identity/v3/projects/672f8c501ac745f1a44c3d38c7b19f0e/users/125cadacc2634c7d9afea73bb8b2eea2/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:02.436889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.438571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.495907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022692a1-f432-4220-b939-ed133a6ea219 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.499727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.500376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.500661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.500965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.502948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.514963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce75b33610242b589b0b29266d04f0c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.535059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1068/2139] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:02 2022] DELETE /identity/v3/users/cce75b33610242b589b0b29266d04f0c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:02.535922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.537370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.582021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.583586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.593198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1072/2140] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:02.593946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.595279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.609621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a5c7-6aa0-4841-a00c-c2c87ce5b49f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.614417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36d4d3-f4bb-41bc-9166-a7d443e55610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.615102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36d4d3-f4bb-41bc-9166-a7d443e55610 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.615394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36d4d3-f4bb-41bc-9166-a7d443e55610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.615683 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36d4d3-f4bb-41bc-9166-a7d443e55610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.616569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36d4d3-f4bb-41bc-9166-a7d443e55610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.618203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36d4d3-f4bb-41bc-9166-a7d443e55610 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.630270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1069/2141] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:02.631405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5145df-030b-476d-be63-808737b22f46 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.631706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5145df-030b-476d-be63-808737b22f46 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.631988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5145df-030b-476d-be63-808737b22f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.655488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8d5145df-030b-476d-be63-808737b22f46 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:02.656870 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8d5145df-030b-476d-be63-808737b22f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.664839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1070/2142] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:02.665494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5145df-030b-476d-be63-808737b22f46 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.676278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5145df-030b-476d-be63-808737b22f46 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.680852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709c8b4-5e33-4c0a-84f7-7d96c4b08b03 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.681154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.682176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.682463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.682748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] PATH_INFO: `/v3/projects/672f8c501ac745f1a44c3d38c7b19f0e/users/125cadacc2634c7d9afea73bb8b2eea2/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.685124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] RBAC: Authorizing `identity:create_grant(project_id=672f8c501ac745f1a44c3d38c7b19f0e, user_id=125cadacc2634c7d9afea73bb8b2eea2, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.686860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.687722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.688014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.688298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] PATH_INFO: `/v3/projects/e711f54570b24ac883c7d98f89c19186` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.688418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.689518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e711f54570b24ac883c7d98f89c19186)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.691737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.701777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1071/2143] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:02 2022] PUT /identity/v3/projects/672f8c501ac745f1a44c3d38c7b19f0e/users/125cadacc2634c7d9afea73bb8b2eea2/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:02.702768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.704608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.771280 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e18bb-49ac-4b82-b22d-c0034ddb879a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:02.775566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac8db-f6f9-40f5-9e53-374743f1185f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:02.778640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac8db-f6f9-40f5-9e53-374743f1185f service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.778640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac8db-f6f9-40f5-9e53-374743f1185f service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.778640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac8db-f6f9-40f5-9e53-374743f1185f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.815343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e711f54570b24ac883c7d98f89c19186', 'request_id': 'req-a497c7b4-798c-41f6-8815-5408a03be8a5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.820805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e711f54570b24ac883c7d98f89c19186', 'request_id': 'req-a497c7b4-798c-41f6-8815-5408a03be8a5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.827698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e711f54570b24ac883c7d98f89c19186', 'request_id': 'req-a497c7b4-798c-41f6-8815-5408a03be8a5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.840418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac8db-f6f9-40f5-9e53-374743f1185f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:02.841939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac8db-f6f9-40f5-9e53-374743f1185f service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:02.852660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1072/2144] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:02.854848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae5ec2-61f3-4d52-b98b-3e0c9345f45c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.855148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae5ec2-61f3-4d52-b98b-3e0c9345f45c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.855433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae5ec2-61f3-4d52-b98b-3e0c9345f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.881588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-deae5ec2-61f3-4d52-b98b-3e0c9345f45c None None] MFA Rules not processed for user `125cadacc2634c7d9afea73bb8b2eea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:02.882855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-deae5ec2-61f3-4d52-b98b-3e0c9345f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.955799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] The token cache is being invalidate because project e711f54570b24ac883c7d98f89c19186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:02.956105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.956910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:02.957826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1073/2145] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:02.963481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1073/2146] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:02 2022] DELETE /identity/v3/projects/e711f54570b24ac883c7d98f89c19186 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:02.965047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c935ba-d307-4d3c-961a-760fe865313d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:02.965401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c935ba-d307-4d3c-961a-760fe865313d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:02.966093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c935ba-d307-4d3c-961a-760fe865313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:02.972982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:02.977937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:02.985222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-90c935ba-d307-4d3c-961a-760fe865313d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:02.986438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-90c935ba-d307-4d3c-961a-760fe865313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.034315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c7b4-798c-41f6-8815-5408a03be8a5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.038174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.038914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.046594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.046594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.046594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.047247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1074/2147] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:03.054603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.054999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.055328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.055651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.056063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.066543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1074/2148] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:03.083844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:03.085412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.100704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1075/2149] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:03.102798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.114271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24e5de-21ad-47a6-8c2e-55ac4f0d1171 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.125748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.132767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.132767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.132767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.132767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:03.132767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.132767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.146061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1075/2150] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:03.149975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.161807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4f0f-e664-4ef8-9d21-807c49a4ecd6 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.166981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.170093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.170093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.170093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.170093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.170949 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.285347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1076/2151] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:03 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:03.286909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.297547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f1bf-08bb-4117-95d1-72dc7d9003b1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.358043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.358805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.359163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.359532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.360299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.362347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.393358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:03.393358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.394243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.410365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18469048-4831-4718-b7e0-41a561e6dbcf admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.417226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.418942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.419241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.419573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] PATH_INFO: `/v3/projects/4cbf9af311814878a79921105b3dabc1` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.421026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbf9af311814878a79921105b3dabc1)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.423240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.454489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1076/2152] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:03 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:03.456801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.458121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.519870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87efe-556a-4764-85e1-ee7e0c81a7dd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.523595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.524249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.524537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.524818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.527657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.587694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.589545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.598621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1077/2153] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:03.599745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.606506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbf9af311814878a79921105b3dabc1', 'request_id': 'req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:03.611327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd70d-dd0c-47d2-8aee-870bba92edf9 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.669547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.670241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.670517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.670802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.671640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.673316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.680587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbf9af311814878a79921105b3dabc1', 'request_id': 'req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:03.687640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1078/2154] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:03.687640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.688398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbf9af311814878a79921105b3dabc1', 'request_id': 'req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:03.689376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.699987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] The token cache is being invalidate because project 4cbf9af311814878a79921105b3dabc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:03.700278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:03.700956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:03.702521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84522ce7-22a5-43ab-9970-e2d75f7a932e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.702643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1077/2155] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:03 2022] DELETE /identity/v3/projects/4cbf9af311814878a79921105b3dabc1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:03.703442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.704757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.710371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.711338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.711624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.711908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] PATH_INFO: `/v3/users/e14576bad67b4b01a570d2c40bd8003b` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.713333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14576bad67b4b01a570d2c40bd8003b)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.715331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.717556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b9fc-b2f5-4e35-9cfc-9632be2386f9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.722221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.722881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.723169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.723453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.724498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.726130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.737693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1078/2156] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:03.738314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:03.740386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:03.755815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba137-702e-49fa-99f9-fed32e824d68 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:03.761672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:03.762574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:03.762843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:03.763126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] PATH_INFO: `/v3/users/51253ff5983c4b32955a8a5e5579d18e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:03.764421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51253ff5983c4b32955a8a5e5579d18e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:03.766424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:03.991988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14576bad67b4b01a570d2c40bd8003b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:03.999752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14576bad67b4b01a570d2c40bd8003b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.000460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14576bad67b4b01a570d2c40bd8003b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.001071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14576bad67b4b01a570d2c40bd8003b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.012697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14576bad67b4b01a570d2c40bd8003b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.068417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51253ff5983c4b32955a8a5e5579d18e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.075785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51253ff5983c4b32955a8a5e5579d18e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.076482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51253ff5983c4b32955a8a5e5579d18e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.077091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51253ff5983c4b32955a8a5e5579d18e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.137853 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1079/2157] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:03 2022] DELETE /identity/v3/users/e14576bad67b4b01a570d2c40bd8003b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:04.138724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:04.140150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:04.213517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58cd5-f08b-4041-80de-86b1444e992f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:04.219116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53ce6-19ee-4954-966e-4975b3bd3fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:04.220510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53ce6-19ee-4954-966e-4975b3bd3fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:04.220932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53ce6-19ee-4954-966e-4975b3bd3fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:04.221639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53ce6-19ee-4954-966e-4975b3bd3fcc admin admin] PATH_INFO: `/v3/projects/bfa712abed104c94913c472a70f89018/users/bde0181bfcfc40568887df6f6e47c92f/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:04.241325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53ce6-19ee-4954-966e-4975b3bd3fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa712abed104c94913c472a70f89018, user_id=bde0181bfcfc40568887df6f6e47c92f, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:04.244119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53ce6-19ee-4954-966e-4975b3bd3fcc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:04.263241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-be6b9784-df7c-4c49-9122-6af5ccbf9d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51253ff5983c4b32955a8a5e5579d18e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:04.286494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1079/2158] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:03 2022] DELETE /identity/v3/users/51253ff5983c4b32955a8a5e5579d18e => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:04.287813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:04.288108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:04.288392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:04.293730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:04.307589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:04.308758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:04.372769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1080/2159] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:04.387121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:04.387991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1080/2160] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:04 2022] PUT /identity/v3/projects/bfa712abed104c94913c472a70f89018/users/bde0181bfcfc40568887df6f6e47c92f/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:04.388679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:04.399842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:04.401257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:04.401761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:04.438001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] MFA Rules not processed for user `bde0181bfcfc40568887df6f6e47c92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:04.439411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:04.464575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81636789-14a8-4fc3-91e3-7ad7c2e0161c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:04.524310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:04.525057 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:04.525934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:04.526234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:04.558170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1081/2161] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:04.576387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:04.577923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:04.619522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:04.621227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:04.641658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1081/2162] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:04.662621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9fb93-108d-49c6-b9f3-84f222c1063f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:04.667242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:04.667996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:04.668355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:04.668709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:04.682342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:04.684917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:04.695737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1082/2163] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:04.836828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:04.839344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:04.862864 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27867f81-7ddb-4998-b33b-60dbaf58404a service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:04.870989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:04.872045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:04.872483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:04.873758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] PATH_INFO: `/v3/projects/767aaa42d64c496285d19fa572e66cfa` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:04.875304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=767aaa42d64c496285d19fa572e66cfa)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:04.878703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.033552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767aaa42d64c496285d19fa572e66cfa', 'request_id': 'req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.097833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767aaa42d64c496285d19fa572e66cfa', 'request_id': 'req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.105734 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767aaa42d64c496285d19fa572e66cfa', 'request_id': 'req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.107066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.109697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:05.119488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] The token cache is being invalidate because project 767aaa42d64c496285d19fa572e66cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:05.119932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.120611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-33ebaa36-795b-4f60-a93b-fa6eb4f81d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.127420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1082/2164] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:04 2022] DELETE /identity/v3/projects/767aaa42d64c496285d19fa572e66cfa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:05.129078 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc811-f52a-477f-be50-566121678735 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.129468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc811-f52a-477f-be50-566121678735 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.129754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc811-f52a-477f-be50-566121678735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.134955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ade5d-10ab-4c6a-a98c-9f2dd7332648 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.153658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-50cbc811-f52a-477f-be50-566121678735 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:05.155563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-50cbc811-f52a-477f-be50-566121678735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:05.203416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.204281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.204566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.204885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] PATH_INFO: `/v3/projects/f4f5292930144c0dbc321ccd3f3b3181` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.206124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f5292930144c0dbc321ccd3f3b3181)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.208139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.216012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1083/2165] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:05.223846 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.224705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.224705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.244286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:05.245591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:05.254131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1084/2166] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:05.258272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.268777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b9f2-151a-4b79-916f-89200021ddb4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.276566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.277171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.277488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.277774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.278523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:05.279016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.280581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.299376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1085/2167] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:05.300401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.310786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65e74-7a68-4118-b7df-dab29e0d8ad0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.315330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.315970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.316255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.316537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.317215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.319617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.384020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f5292930144c0dbc321ccd3f3b3181', 'request_id': 'req-e29f5f58-33c8-44ae-b922-34c01910b70c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.390352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f5292930144c0dbc321ccd3f3b3181', 'request_id': 'req-e29f5f58-33c8-44ae-b922-34c01910b70c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.396889 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f5292930144c0dbc321ccd3f3b3181', 'request_id': 'req-e29f5f58-33c8-44ae-b922-34c01910b70c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.481608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] The token cache is being invalidate because project f4f5292930144c0dbc321ccd3f3b3181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:05.481951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.482691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.488301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1086/2168] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:05 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:05.488471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1083/2169] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:05 2022] DELETE /identity/v3/projects/f4f5292930144c0dbc321ccd3f3b3181 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:05.489295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.489436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.491421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:05.491607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:05.548670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:05.586945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f5f58-33c8-44ae-b922-34c01910b70c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.594095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797509-e5d8-4214-963c-1adbe09bedb3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.595508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.596283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.596631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.596975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.597773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.599708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.600023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.601543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.601543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.601543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] PATH_INFO: `/v3/users/78d16aeffbbf464fb444c1b2e6526dae` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.602542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d16aeffbbf464fb444c1b2e6526dae)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.604748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.706981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1084/2170] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:05 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:05.708171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.721943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb225b-8ecc-42d2-b461-0a1c007dde65 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.728958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.729850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.730240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.730736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.731589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.748043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.759009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1085/2171] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:05.761079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.786464 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1983-ff6e-47ef-b380-07ed5db9b786 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.794636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.795670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.796732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.797169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.798124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.800390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.813550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1086/2172] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:05.817894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:05.830265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da185fd6-01bd-4909-a839-c0e12c4de9e7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:05.835443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781200d2-b2cc-4b04-90c9-87d0f4432213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:05.836493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781200d2-b2cc-4b04-90c9-87d0f4432213 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:05.836794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781200d2-b2cc-4b04-90c9-87d0f4432213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:05.837078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781200d2-b2cc-4b04-90c9-87d0f4432213 admin admin] PATH_INFO: `/v3/projects/62e463f8e83442e0b7a2f1ce15ae90a7/users/1013248590ac430bb2843198b1f9b503/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:05.856322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781200d2-b2cc-4b04-90c9-87d0f4432213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e463f8e83442e0b7a2f1ce15ae90a7, user_id=1013248590ac430bb2843198b1f9b503, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:05.857133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d16aeffbbf464fb444c1b2e6526dae'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.859152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781200d2-b2cc-4b04-90c9-87d0f4432213 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:05.865929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d16aeffbbf464fb444c1b2e6526dae'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.866662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d16aeffbbf464fb444c1b2e6526dae'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.867288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d16aeffbbf464fb444c1b2e6526dae'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.983863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d16aeffbbf464fb444c1b2e6526dae'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:05.990677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1087/2173] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:05 2022] PUT /identity/v3/projects/62e463f8e83442e0b7a2f1ce15ae90a7/users/1013248590ac430bb2843198b1f9b503/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:06.009323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1087/2174] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:05 2022] DELETE /identity/v3/users/78d16aeffbbf464fb444c1b2e6526dae => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:06.061361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:06.061656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:06.061952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:06.093498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] MFA Rules not processed for user `1013248590ac430bb2843198b1f9b503`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:06.094918 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:06.177490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1088/2175] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:06.189068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:06.191190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:06.253413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0748c4-bd07-4c00-8af5-c3335b776a0a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:06.257257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:06.257990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:06.258275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:06.258555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:06.286638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:06.288475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:06.300929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1088/2176] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:06.564093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:06.566549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:06.656810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8355-0f03-45bd-bf64-e240cd8ce3c8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:06.661727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:06.662614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:06.662903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:06.663183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] PATH_INFO: `/v3/projects/419a02da1d7d432c84c90259987ce465` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:06.664370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=419a02da1d7d432c84c90259987ce465)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:06.666483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:06.858914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419a02da1d7d432c84c90259987ce465', 'request_id': 'req-5490173d-5b9d-4cff-a150-8d7f8746ef20'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:06.864547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419a02da1d7d432c84c90259987ce465', 'request_id': 'req-5490173d-5b9d-4cff-a150-8d7f8746ef20'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:06.872055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419a02da1d7d432c84c90259987ce465', 'request_id': 'req-5490173d-5b9d-4cff-a150-8d7f8746ef20'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:06.984568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:06.992861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] The token cache is being invalidate because project 419a02da1d7d432c84c90259987ce465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:06.993212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:06.994007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:06.996261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1089/2177] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:06 2022] DELETE /identity/v3/projects/419a02da1d7d432c84c90259987ce465 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:07.010062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:07.028514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b52b6-60b6-4b42-b1a1-9ed08639eb12 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:07.088807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:07.089700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:07.089989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:07.090283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] PATH_INFO: `/v3/users/bff47d880f9042fa978752eaff8a0e32` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:07.091832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff47d880f9042fa978752eaff8a0e32)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:07.095037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:07.409633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff47d880f9042fa978752eaff8a0e32'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:07.419282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff47d880f9042fa978752eaff8a0e32'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:07.419997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff47d880f9042fa978752eaff8a0e32'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:07.420637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff47d880f9042fa978752eaff8a0e32'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:07.601480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b5e04c0b-426d-42e3-b8ba-a1af6508160c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff47d880f9042fa978752eaff8a0e32'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:07.619838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1089/2178] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:07 2022] DELETE /identity/v3/users/bff47d880f9042fa978752eaff8a0e32 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:08.127772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:08.130811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:08.147246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490173d-5b9d-4cff-a150-8d7f8746ef20 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:08.229967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:08.232059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.232347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.232633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] PATH_INFO: `/v3/projects/e03c64adbf414230b459aa49560aa26d` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.233904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03c64adbf414230b459aa49560aa26d)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:08.236174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:08.380216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03c64adbf414230b459aa49560aa26d', 'request_id': 'req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.386289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03c64adbf414230b459aa49560aa26d', 'request_id': 'req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.395141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03c64adbf414230b459aa49560aa26d', 'request_id': 'req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.499129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:08.512151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] The token cache is being invalidate because project e03c64adbf414230b459aa49560aa26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:08.512151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.512151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.512151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1090/2179] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:08 2022] DELETE /identity/v3/projects/e03c64adbf414230b459aa49560aa26d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:08.512595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0087f4-6e05-4305-8394-b5bcd063fd51 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.512595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0087f4-6e05-4305-8394-b5bcd063fd51 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.518463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0087f4-6e05-4305-8394-b5bcd063fd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.535560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:08.537161 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:08.539838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8a0087f4-6e05-4305-8394-b5bcd063fd51 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:08.541184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8a0087f4-6e05-4305-8394-b5bcd063fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:08.610971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1090/2180] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:08.611674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e31c-115f-4a82-9ff8-a84acbf15fc5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:08.618926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.619312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.619715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.622364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:08.623250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.623533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.623808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] PATH_INFO: `/v3/users/bde0181bfcfc40568887df6f6e47c92f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.625030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde0181bfcfc40568887df6f6e47c92f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:08.627037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:08.639446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:08.640848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:08.651410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1091/2181] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:08.656570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:08.665830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef421b7-6a6a-497a-83a5-a92d39e1a523 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:08.671173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:08.671889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.672182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.672467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.673200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:08.673552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:08.675256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:08.687754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1092/2182] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:50:08.693181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:08.703705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a937c-c61d-416a-a57f-8c643ab57ab1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:08.708813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:08.709477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.709762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.713724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.713724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:08.713724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:08.843274 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1093/2183] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:08 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:08.848528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:08.887343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde0181bfcfc40568887df6f6e47c92f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.895058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde0181bfcfc40568887df6f6e47c92f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.896044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde0181bfcfc40568887df6f6e47c92f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.896938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde0181bfcfc40568887df6f6e47c92f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.909985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-57d7a189-4b92-4e9a-96ba-927e0be59129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde0181bfcfc40568887df6f6e47c92f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:08.924354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced5df5-9e08-4d0f-b43b-07b60ad2738e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:08.929252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:08.930147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:08.930401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:08.930714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:08.931414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:08.933477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.012927 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1091/2184] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:08 2022] DELETE /identity/v3/users/bde0181bfcfc40568887df6f6e47c92f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:09.017342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.017704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.017992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.035531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:09.036772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.082996 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1094/2185] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:08 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:09.084539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.087223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.114352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1122-1d64-4fbb-8225-3931735744b1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.117814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1092/2186] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:09.122066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.124803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.143260 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.143260 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.143590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb5e6-ab70-48d0-b32b-8df33b93f91f None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.144006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.144006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] PATH_INFO: `/v3/users/a1a6162c6db54678ab156f35cd4996eb` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.144006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a6162c6db54678ab156f35cd4996eb)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.145745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.149747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.150429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.150768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.151057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.152746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.154400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.166104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1093/2187] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:09.167192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.169015 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.226644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b4469-7cb6-475e-b168-7c83c57bb072 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.230530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.231977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.232319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.232603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.242681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.244086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.257979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1094/2188] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:09.257979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.265579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ba03-c958-4e84-abd2-fb926dff6da8 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.270805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.271478 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.271768 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.272053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.272785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.274660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.287139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1095/2189] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:09.291518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.302341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb6fc-151c-4795-b0fc-86521b080d4d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.307772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4216e-4bee-49b3-b2a8-0cf6f161ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.308892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4216e-4bee-49b3-b2a8-0cf6f161ad10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.309306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4216e-4bee-49b3-b2a8-0cf6f161ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.309914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4216e-4bee-49b3-b2a8-0cf6f161ad10 admin admin] PATH_INFO: `/v3/projects/111d727f542c48d3927eff92be1e7c31/users/bb820b9eeb29454d9d65715bd6898018/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.326967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4216e-4bee-49b3-b2a8-0cf6f161ad10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111d727f542c48d3927eff92be1e7c31, user_id=bb820b9eeb29454d9d65715bd6898018, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.331265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4216e-4bee-49b3-b2a8-0cf6f161ad10 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.368296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a6162c6db54678ab156f35cd4996eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.376207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a6162c6db54678ab156f35cd4996eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.376913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a6162c6db54678ab156f35cd4996eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.377708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a6162c6db54678ab156f35cd4996eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.419249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1096/2190] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:09 2022] PUT /identity/v3/projects/111d727f542c48d3927eff92be1e7c31/users/bb820b9eeb29454d9d65715bd6898018/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:09.430332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.430630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.430914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.454615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-73ff8cbc-0c80-43b8-a7ab-cc00013c1b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a6162c6db54678ab156f35cd4996eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.469082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] MFA Rules not processed for user `bb820b9eeb29454d9d65715bd6898018`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:09.471260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.475904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1095/2191] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:09 2022] DELETE /identity/v3/users/a1a6162c6db54678ab156f35cd4996eb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:09.481191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.481534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.481818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.501915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:09.503700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.518503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:09.571461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1096/2192] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:09.583665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.585154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.588503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1097/2193] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:09.593153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.594859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.609188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32282501-a8f5-4e81-bd96-51b0400d59b5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.614746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.617138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.617138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.617138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.617138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.618929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.649786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5482c-180d-4c3b-bd6b-3ad0c48eb684 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.656133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.656952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.657316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.657667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.668890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.670361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.680852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1097/2194] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:09.707291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1098/2195] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:09 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:09.711617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.722576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd051a86-c9f8-42a2-917b-e7f27e0ff350 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.780605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.781304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.781600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.781887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.782603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.785948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.791656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.793565 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:09.809217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8765df-4aa8-4260-b48a-92ba7328f190 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.815587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.816550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.816847 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.817137 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] PATH_INFO: `/v3/projects/bfa712abed104c94913c472a70f89018` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.819584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa712abed104c94913c472a70f89018)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.821724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.927898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1098/2196] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:09 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:09.931827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.942059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a39f38-24b2-4338-a63f-aad92c57987c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.949922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:09.950707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:09.950995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:09.951272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:09.952080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:09.953822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:09.969624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa712abed104c94913c472a70f89018', 'request_id': 'req-7580603d-2c4a-4ea8-a3b6-db84d84473fb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.970304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1099/2197] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:09.971279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:09.978778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa712abed104c94913c472a70f89018', 'request_id': 'req-7580603d-2c4a-4ea8-a3b6-db84d84473fb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:09.982835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6e4cf-169f-4085-ac2f-957e51f64a61 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:09.987289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa712abed104c94913c472a70f89018', 'request_id': 'req-7580603d-2c4a-4ea8-a3b6-db84d84473fb'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.046702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.047597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.048016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.048364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.049814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.055213 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.068309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1100/2198] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:10.072153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.083536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7924-c7c4-40b3-bdce-57c64603511a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.089991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.090218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] The token cache is being invalidate because project bfa712abed104c94913c472a70f89018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:10.090218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.090956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.090956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.091130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] PATH_INFO: `/v3/projects/173e9b641d88440a9e4271141416681a/users/1b31ae667cbf4aeea074e9a8c34e45a7/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.092737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-7580603d-2c4a-4ea8-a3b6-db84d84473fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.095664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1099/2199] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:09 2022] DELETE /identity/v3/projects/bfa712abed104c94913c472a70f89018 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:10.100860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605891-14d0-42df-89d3-172788862753 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.101177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605891-14d0-42df-89d3-172788862753 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.101507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605891-14d0-42df-89d3-172788862753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.112713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=173e9b641d88440a9e4271141416681a, user_id=1b31ae667cbf4aeea074e9a8c34e45a7, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.115855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.126817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-75605891-14d0-42df-89d3-172788862753 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:10.128047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-75605891-14d0-42df-89d3-172788862753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.137443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1100/2200] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:10.145264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.145985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.145985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.169666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:10.171291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.179825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1101/2201] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:10.185420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.196502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624c2a4-827e-4ab5-a915-b0b57fe193e8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.202127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.202805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.203096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.203495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.204150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:10.204475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.206151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.219839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1102/2202] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:50:10.224429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.235409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364922e-ca1c-45b9-9807-635720a7bcf7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.240231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f49cc7-9e4a-40ab-ace8-9f85c2525375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.240924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f49cc7-9e4a-40ab-ace8-9f85c2525375 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.241171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f49cc7-9e4a-40ab-ace8-9f85c2525375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.241746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f49cc7-9e4a-40ab-ace8-9f85c2525375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.242194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f49cc7-9e4a-40ab-ace8-9f85c2525375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.244430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f49cc7-9e4a-40ab-ace8-9f85c2525375 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.248153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:10.291373 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1101/2203] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:10 2022] PUT /identity/v3/projects/173e9b641d88440a9e4271141416681a/users/1b31ae667cbf4aeea074e9a8c34e45a7/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:10.292266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.294544 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.334551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1103/2204] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:10.336296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.336780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.337124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.366961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] MFA Rules not processed for user `1b31ae667cbf4aeea074e9a8c34e45a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:10.368327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.376905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d0354-b5ba-4f37-adea-e58517b1f2ea admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.437609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.438568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.438933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.439294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] PATH_INFO: `/v3/projects/29bbeee2363d451bb307d1ab19569946` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.440707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bbeee2363d451bb307d1ab19569946)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.442764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.443707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1104/2205] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:10.446317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.461559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454342-e01c-4aa2-ab70-95bddf6f5a48 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.467241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.468153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.468274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.468580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.470012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.471584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.579329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bbeee2363d451bb307d1ab19569946', 'request_id': 'req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.579895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1105/2206] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:10.581035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.582954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.601287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a7047-9943-485d-b016-1b3313ef8fb6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.663937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.664598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.664886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.665208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.665939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.668415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.687452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bbeee2363d451bb307d1ab19569946', 'request_id': 'req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.695526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bbeee2363d451bb307d1ab19569946', 'request_id': 'req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.707547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] The token cache is being invalidate because project 29bbeee2363d451bb307d1ab19569946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:10.707842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.708826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:10.711014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1102/2207] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:10 2022] DELETE /identity/v3/projects/29bbeee2363d451bb307d1ab19569946 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:10.711840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.713165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.726265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddbe0b-e4ac-402a-a832-3ad8b8b45da4 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.734696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.735709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.736132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.736565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.737841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.739920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.751722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1103/2208] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:10.752569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.754454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.763594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1106/2209] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:10.764667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.767808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a730-372f-44a4-b62b-8ba92b72ce24 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.832548 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b80b3-0cac-4924-abd6-b0172be581bd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.837476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.838207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.838506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.838790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.840340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.842003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.846831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.847761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.848047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.848334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] PATH_INFO: `/v3/users/ac18edc7db564a26a0556de7d4cb32ca` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.849621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac18edc7db564a26a0556de7d4cb32ca)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.851886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.854170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1107/2210] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:10.855109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:10.859291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:10.872284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab912-49e0-48d7-9fa8-ceef0f976517 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:10.877456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:10.877986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:10.878272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:10.878550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:10.879242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:10.881307 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:10.890470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:11.005345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1108/2211] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:10 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:11.005345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.014500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976352e-ebcd-445f-b8f1-7bae922458d1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.019229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.020141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.020431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.020714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] PATH_INFO: `/v3/projects/1e753961ac524b318da4d4c5017222f6/users/833b7e7f3f7f4851bf1e9ed892dfbd67/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.037336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e753961ac524b318da4d4c5017222f6, user_id=833b7e7f3f7f4851bf1e9ed892dfbd67, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.042742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.147610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac18edc7db564a26a0556de7d4cb32ca'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.155222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac18edc7db564a26a0556de7d4cb32ca'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.155916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac18edc7db564a26a0556de7d4cb32ca'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.156549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac18edc7db564a26a0556de7d4cb32ca'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.167550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1109/2212] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:11 2022] PUT /identity/v3/projects/1e753961ac524b318da4d4c5017222f6/users/833b7e7f3f7f4851bf1e9ed892dfbd67/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:11.169221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.171001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:11.242004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441c0e-672f-470a-9e02-aa9a249a5682 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.246875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a802c2c-9748-4431-ae37-282a9c91c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.247541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a802c2c-9748-4431-ae37-282a9c91c524 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.247826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a802c2c-9748-4431-ae37-282a9c91c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.248106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a802c2c-9748-4431-ae37-282a9c91c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.248826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a802c2c-9748-4431-ae37-282a9c91c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.250507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a802c2c-9748-4431-ae37-282a9c91c524 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.260849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1110/2213] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:11.262789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.263113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.263396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.275636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac18edc7db564a26a0556de7d4cb32ca'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.298059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] MFA Rules not processed for user `833b7e7f3f7f4851bf1e9ed892dfbd67`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:11.299981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1104/2214] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:10 2022] DELETE /identity/v3/users/ac18edc7db564a26a0556de7d4cb32ca => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:11.300946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.310870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:11.379143 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed002090-15a5-44cb-8a8c-370709a4addd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.469304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.469304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.469304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.469304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] PATH_INFO: `/v3/projects/d32817f31f164395be56f9a7c4899523/users/cadd27af21ca4f45870f64c4990c7f5a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.469980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1111/2215] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:11.470086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32817f31f164395be56f9a7c4899523, user_id=cadd27af21ca4f45870f64c4990c7f5a, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.470086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.470256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.470256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:11.523113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84558-ad92-4cd4-97ff-5c6b6447c5ab None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.526790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.528073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.528429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.528716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.537115 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.538584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.548045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1112/2216] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:11.574740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.576254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:11.591067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b192-47e0-4f61-8dd5-ef57abb53179 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.596465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.597362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.597652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.597937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] PATH_INFO: `/v3/users/833b7e7f3f7f4851bf1e9ed892dfbd67` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.599239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833b7e7f3f7f4851bf1e9ed892dfbd67)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.601503 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.751542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1105/2217] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:11 2022] PUT /identity/v3/projects/d32817f31f164395be56f9a7c4899523/users/cadd27af21ca4f45870f64c4990c7f5a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:11.755470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.833563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f3a0e-2a15-41fc-922d-1d6e37c02de0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.838251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.838993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.839367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.839898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.840827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.842583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.853070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1106/2218] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:11.861791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:11.867285 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f00b-7a37-40cd-b3d2-e6fe525f7dbd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:11.872803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77213b01-1e3e-43fa-984c-43af4a3db61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:11.874339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213b01-1e3e-43fa-984c-43af4a3db61c admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.874629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213b01-1e3e-43fa-984c-43af4a3db61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.874922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213b01-1e3e-43fa-984c-43af4a3db61c admin admin] PATH_INFO: `/v3/projects/d32817f31f164395be56f9a7c4899523/users/cadd27af21ca4f45870f64c4990c7f5a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.876894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213b01-1e3e-43fa-984c-43af4a3db61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32817f31f164395be56f9a7c4899523, user_id=cadd27af21ca4f45870f64c4990c7f5a, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:11.879732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213b01-1e3e-43fa-984c-43af4a3db61c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:11.890742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1107/2219] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:11 2022] PUT /identity/v3/projects/d32817f31f164395be56f9a7c4899523/users/cadd27af21ca4f45870f64c4990c7f5a/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:11.908033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:11.908351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:11.908665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:11.935767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] MFA Rules not processed for user `cadd27af21ca4f45870f64c4990c7f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:11.936983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:11.955399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833b7e7f3f7f4851bf1e9ed892dfbd67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.963869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833b7e7f3f7f4851bf1e9ed892dfbd67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.964628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833b7e7f3f7f4851bf1e9ed892dfbd67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.965459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833b7e7f3f7f4851bf1e9ed892dfbd67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:11.978137 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833b7e7f3f7f4851bf1e9ed892dfbd67'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:12.007776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1108/2220] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:12.019793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.021167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.084592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1113/2221] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:11 2022] DELETE /identity/v3/users/833b7e7f3f7f4851bf1e9ed892dfbd67 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:12.090598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.090598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.091409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a682f-c3ac-4185-b1a8-b37479f8e5b1 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.143367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.144046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.144333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.144631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.146522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.158065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c297451-2da5-42b0-8336-6fe0d7c634e7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.162800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.163651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.163935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.164217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] PATH_INFO: `/v3/projects/83ea56c71a23484f9dfe59a3a36217d3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.165450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ea56c71a23484f9dfe59a3a36217d3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.167405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:12.169439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:12.208309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.209800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1589e03-6fb3-4e47-89d3-0836154ab038 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:12.219669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1109/2222] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:12.220969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.221239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.221557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.241855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:12.245111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.252589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1110/2223] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:12.262969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.264371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.322356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ea56c71a23484f9dfe59a3a36217d3', 'request_id': 'req-3e127734-07fc-4594-8756-a71956a4eaee'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:12.324442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da5382-ab05-4e1e-983d-306278b7afa5 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.328735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ea56c71a23484f9dfe59a3a36217d3', 'request_id': 'req-3e127734-07fc-4594-8756-a71956a4eaee'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:12.337101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ea56c71a23484f9dfe59a3a36217d3', 'request_id': 'req-3e127734-07fc-4594-8756-a71956a4eaee'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:12.382068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e9c6-6052-4fac-99a9-b09dbc9863a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.383132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e9c6-6052-4fac-99a9-b09dbc9863a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.383605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e9c6-6052-4fac-99a9-b09dbc9863a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.384075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e9c6-6052-4fac-99a9-b09dbc9863a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.413353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] The token cache is being invalidate because project 83ea56c71a23484f9dfe59a3a36217d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:12.413650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:12.414452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e127734-07fc-4594-8756-a71956a4eaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:12.416636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1114/2224] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:12 2022] DELETE /identity/v3/projects/83ea56c71a23484f9dfe59a3a36217d3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:12.422258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.422841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.423135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.442168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:12.443399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.472503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e9c6-6052-4fac-99a9-b09dbc9863a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.473977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e9c6-6052-4fac-99a9-b09dbc9863a7 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:12.485314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1111/2225] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:12.506483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1115/2226] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:12.515272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.515647 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.516016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.535294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:12.536561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:12.545209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1112/2227] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:12.549686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.563615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22729f4-388b-46e9-8fef-284854571a2b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.568394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.569065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.569390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.569676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.570451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:12.570766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.572440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:12.585981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1116/2228] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:12.590601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.602022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb97ade-c1c4-445c-9aa8-cb2b8540e8b4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.605070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.605786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.606076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.606359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.607053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.608966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:12.681636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:12.761766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1113/2229] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:12 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:12.765891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.773472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be4666-7382-4cb9-88de-27c21ee96080 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.838895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.840363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.840363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.840363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.841624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.843217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:12.954223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1117/2230] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:12 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:12.965343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:12.974354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a52d-84ca-4322-9cda-faa8b929da28 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:12.979482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:12.980148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:12.980998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:12.981552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:12.982356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:12.983986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:13.000111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1114/2231] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:13.003298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:13.013662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9426-ae14-4d08-8f36-52b041c5601e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:13.019282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:13.019962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:13.020244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:13.020521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:13.021255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:13.022950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:13.033641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1118/2232] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:13.038637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:13.045369 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:13.047242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:13.050867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e600fdc-e734-47b5-94dc-548519cd1b74 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:13.059130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4aca7d-9fd6-43c7-a947-3b4c071fcbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:13.061080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aca7d-9fd6-43c7-a947-3b4c071fcbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:13.061412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aca7d-9fd6-43c7-a947-3b4c071fcbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:13.061714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aca7d-9fd6-43c7-a947-3b4c071fcbb5 admin admin] PATH_INFO: `/v3/projects/332bd1f302654c02b5181f8bad39a94e/users/98f2398da561427a8e9dbafd53e344a1/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:13.067233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6773-673c-4e95-9c7d-ed875bdff5c6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:13.074845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:13.074845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:13.074845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:13.074845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] PATH_INFO: `/v3/projects/1e753961ac524b318da4d4c5017222f6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:13.075961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e753961ac524b318da4d4c5017222f6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:13.078078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:13.080295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4aca7d-9fd6-43c7-a947-3b4c071fcbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332bd1f302654c02b5181f8bad39a94e, user_id=98f2398da561427a8e9dbafd53e344a1, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:13.083860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4aca7d-9fd6-43c7-a947-3b4c071fcbb5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:13.167718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1115/2233] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:13 2022] PUT /identity/v3/projects/332bd1f302654c02b5181f8bad39a94e/users/98f2398da561427a8e9dbafd53e344a1/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:13.180016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:13.180307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:13.180587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:13.204429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e753961ac524b318da4d4c5017222f6', 'request_id': 'req-e15ed3ca-fef4-498d-a9b9-74218bae221d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:13.207119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] MFA Rules not processed for user `98f2398da561427a8e9dbafd53e344a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:13.208369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:13.209685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e753961ac524b318da4d4c5017222f6', 'request_id': 'req-e15ed3ca-fef4-498d-a9b9-74218bae221d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:13.218392 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e753961ac524b318da4d4c5017222f6', 'request_id': 'req-e15ed3ca-fef4-498d-a9b9-74218bae221d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:13.274893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1116/2234] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:13.282340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] The token cache is being invalidate because project 1e753961ac524b318da4d4c5017222f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:13.282635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:13.283287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:13.284848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1119/2235] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:13 2022] DELETE /identity/v3/projects/1e753961ac524b318da4d4c5017222f6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:13.287883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:13.289739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:13.354263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8b0af-f510-4fc2-8bb6-86b42a9812e7 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:13.358832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:13.359508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:13.359795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:13.360085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:13.361961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:13.374004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:13.379649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:13.386950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1117/2236] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:13.396287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:13.859075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.025034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.344844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.414011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.659472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.733421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.756752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.825080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.887576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:14.962102 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:15.179642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:15.385258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:15.916496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:16.362488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:16.362699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:16.364106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:16.377770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ed3ca-fef4-498d-a9b9-74218bae221d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:16.381335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:16.381981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:16.382270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:16.382556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:16.384923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:16.456748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:16.458575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:16.469013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1120/2237] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:16.471056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:16.545474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:17.237232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:17.367926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:17.762529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:17.859885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.145206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.253785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.470808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.579861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.619948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.637827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:18.639349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:18.651079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e622d2d-dd6e-48ee-a3d7-184c5ac9af48 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:18.655674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:18.656413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:18.656822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:18.657168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:18.659095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:18.711480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:18.725783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:18.727534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a4df5-d4fe-414b-87e6-7120110a513e service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:18.738622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1118/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:18.786010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:19.048159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:19.385922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:19.477495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:19.586133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:19.866073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:20.214015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:20.529734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:20.631488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:20.687716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:20.689177 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:20.757095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644cc8-fa50-4dfa-965b-e1134f25e2f4 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:20.761710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:20.763245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:20.763485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:20.763786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] PATH_INFO: `/v3/users/98f2398da561427a8e9dbafd53e344a1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:20.765095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f2398da561427a8e9dbafd53e344a1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:20.767067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:20.824248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:21.065972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f2398da561427a8e9dbafd53e344a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:21.074804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f2398da561427a8e9dbafd53e344a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:21.075632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f2398da561427a8e9dbafd53e344a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:21.076243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f2398da561427a8e9dbafd53e344a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:21.088065 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f2398da561427a8e9dbafd53e344a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:21.242483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1121/2239] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:20 2022] DELETE /identity/v3/users/98f2398da561427a8e9dbafd53e344a1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:21.245462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:21.245906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:21.246019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:21.283114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:21.283114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:21.283114 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:21.348543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1119/2240] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:21.359994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:21.361585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:21.422985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714fd6-cc80-41b4-976f-bb7eb6c95e5f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:21.426852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27cb4e-72d2-41ee-9e77-44f781235969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:21.427449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27cb4e-72d2-41ee-9e77-44f781235969 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:21.427740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27cb4e-72d2-41ee-9e77-44f781235969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:21.428053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27cb4e-72d2-41ee-9e77-44f781235969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:21.438353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27cb4e-72d2-41ee-9e77-44f781235969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:21.439804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27cb4e-72d2-41ee-9e77-44f781235969 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:21.450197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1122/2241] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:21.920539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:21.928978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:21.937706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e00d-cc19-4b91-8128-8332ce2971fd None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:21.944230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:21.945684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:21.946739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:21.946739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] PATH_INFO: `/v3/projects/332bd1f302654c02b5181f8bad39a94e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:21.949109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332bd1f302654c02b5181f8bad39a94e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:21.953897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:21.991684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:22.113785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332bd1f302654c02b5181f8bad39a94e', 'request_id': 'req-049bd7b6-8dba-4846-b0bc-d32465f26230'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:22.254656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332bd1f302654c02b5181f8bad39a94e', 'request_id': 'req-049bd7b6-8dba-4846-b0bc-d32465f26230'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:22.274623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332bd1f302654c02b5181f8bad39a94e', 'request_id': 'req-049bd7b6-8dba-4846-b0bc-d32465f26230'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:22.288711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] The token cache is being invalidate because project 332bd1f302654c02b5181f8bad39a94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:22.289187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:22.290436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-049bd7b6-8dba-4846-b0bc-d32465f26230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:22.292816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1120/2242] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:21 2022] DELETE /identity/v3/projects/332bd1f302654c02b5181f8bad39a94e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:22.297998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.298331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.298619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.331656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:22.331656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:22.397178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1123/2243] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:22.405076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.405487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.405775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.424829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:22.426069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:22.435850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1121/2244] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:22.440286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:22.450073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771938d4-2e8f-480b-8b97-7bc889e83ea0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:22.455379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:22.456055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.456348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.456746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.457512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:22.457827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:22.459480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:22.471731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1124/2245] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:50:22.476635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:22.486625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23671f-7240-4605-9569-d4edf38e690d None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:22.491479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:22.492136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.492462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.492742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.493483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:22.495378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:22.634468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:22.657612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1122/2246] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:22 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:22.657911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:22.676469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf095571-b9a5-41cf-bdcd-7fedb450fe39 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:22.736984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:22.737707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.737997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.738280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.738979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:22.740915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:22.746390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:22.898462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1125/2247] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:22 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:22.899934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:22.912658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7baa73-0378-4780-8545-7ad7068b279b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:22.922318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:22.923002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.924383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.924383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.924619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:22.926382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:22.942000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1123/2248] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:22.945803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:22.956334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2e3d-ffe1-4050-966b-3ddba496244e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:22.961140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bd82c-977d-4f28-b20c-f42eea6e51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:22.961934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bd82c-977d-4f28-b20c-f42eea6e51ff admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.966682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bd82c-977d-4f28-b20c-f42eea6e51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.966682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bd82c-977d-4f28-b20c-f42eea6e51ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:22.966682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bd82c-977d-4f28-b20c-f42eea6e51ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:22.966682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bd82c-977d-4f28-b20c-f42eea6e51ff admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:22.975922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1126/2249] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:22.980355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:22.991167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd2f1-a1e0-46f0-a4fa-32f7aa0ca242 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:22.997319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:22.997319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:22.997319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:22.998137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] PATH_INFO: `/v3/projects/83fb026ffcbd4a71929a4b3c860b3bee/users/127c04cf84664a7582853dec90f130b6/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:23.012987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fb026ffcbd4a71929a4b3c860b3bee, user_id=127c04cf84664a7582853dec90f130b6, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:23.016034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:23.135161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1124/2250] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:22 2022] PUT /identity/v3/projects/83fb026ffcbd4a71929a4b3c860b3bee/users/127c04cf84664a7582853dec90f130b6/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:23.140828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:23.141328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:23.141490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:23.159237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:23.160434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:23.230944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1127/2251] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:23.242021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:23.244169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:23.306642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40c598-a1e7-4098-8a7a-7b5b43454e55 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:23.311025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:23.311700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:23.311985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:23.312265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:23.321770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:23.323192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:23.333159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1125/2252] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:23.614855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:23.730135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:23.802502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:23.803948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:23.817876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219acf48-64fe-45db-b1f0-462c035861fe None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:23.823778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:23.824971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:23.825991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:23.830917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] PATH_INFO: `/v3/users/bb820b9eeb29454d9d65715bd6898018` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:23.830917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb820b9eeb29454d9d65715bd6898018)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:23.832290 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:24.128955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb820b9eeb29454d9d65715bd6898018'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.136053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb820b9eeb29454d9d65715bd6898018'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.136784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb820b9eeb29454d9d65715bd6898018'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.137436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb820b9eeb29454d9d65715bd6898018'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.146443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:24.148065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:24.161063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3cf9f1ca-268d-4dea-a27b-fa207d1a2c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb820b9eeb29454d9d65715bd6898018'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.163219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12faa6-6efa-4ef9-a1e9-7459ddb4c45a service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:24.168442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:24.169460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:24.170070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:24.170070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] PATH_INFO: `/v3/users/06767dd8c35d49cc9594120c47f97db2` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:24.171215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06767dd8c35d49cc9594120c47f97db2)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:24.173130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:24.296885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1128/2253] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:23 2022] DELETE /identity/v3/users/bb820b9eeb29454d9d65715bd6898018 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:24.301617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:24.301914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:24.302199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:24.326566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:24.327989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:24.395961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1129/2254] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:24.405808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:24.407374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:24.475743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04be95-7796-4c9c-9617-d4f8dfdfb8b5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:24.479685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5cbdb-bd49-4469-8451-a32aa6354173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:24.480330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5cbdb-bd49-4469-8451-a32aa6354173 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:24.480618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5cbdb-bd49-4469-8451-a32aa6354173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:24.480897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5cbdb-bd49-4469-8451-a32aa6354173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:24.492252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5cbdb-bd49-4469-8451-a32aa6354173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:24.493956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5cbdb-bd49-4469-8451-a32aa6354173 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:24.505783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1130/2255] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:24.566817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06767dd8c35d49cc9594120c47f97db2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.573613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06767dd8c35d49cc9594120c47f97db2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.574312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06767dd8c35d49cc9594120c47f97db2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.574946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06767dd8c35d49cc9594120c47f97db2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.660658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06767dd8c35d49cc9594120c47f97db2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:24.684679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1126/2256] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:24 2022] DELETE /identity/v3/users/06767dd8c35d49cc9594120c47f97db2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:24.689852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:24.690467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:24.690979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:24.727965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:24.745148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:24.831608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1131/2257] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:24.847297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:24.849000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:24.932211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159847c5-985b-494c-be61-97d565ce555b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:24.938017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c7c6f-2609-43ee-96f3-cc903d1eb528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:24.938746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c7c6f-2609-43ee-96f3-cc903d1eb528 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:24.939036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c7c6f-2609-43ee-96f3-cc903d1eb528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:24.939312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c7c6f-2609-43ee-96f3-cc903d1eb528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:24.950789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c7c6f-2609-43ee-96f3-cc903d1eb528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:24.952338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c7c6f-2609-43ee-96f3-cc903d1eb528 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:24.963948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1127/2258] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:25.110205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:25.112111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:25.131693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087809c-67f3-44ce-9321-8432825e63d1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:25.142849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:25.142849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:25.142849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:25.142849 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] PATH_INFO: `/v3/projects/111d727f542c48d3927eff92be1e7c31` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:25.143938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=111d727f542c48d3927eff92be1e7c31)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:25.146334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:25.152532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb110-570e-422f-b279-80553456d0e0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:25.152833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb110-570e-422f-b279-80553456d0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:25.153116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb110-570e-422f-b279-80553456d0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:25.197549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-384eb110-570e-422f-b279-80553456d0e0 None None] MFA Rules not processed for user `127c04cf84664a7582853dec90f130b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:25.198923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-384eb110-570e-422f-b279-80553456d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:25.283805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1128/2259] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:25.295204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb110-570e-422f-b279-80553456d0e0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:25.296802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-384eb110-570e-422f-b279-80553456d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:25.341080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:25.373146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb110-570e-422f-b279-80553456d0e0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:25.383350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111d727f542c48d3927eff92be1e7c31', 'request_id': 'req-98003fc8-d2d3-4168-8706-84c6e5e9c69d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.396809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111d727f542c48d3927eff92be1e7c31', 'request_id': 'req-98003fc8-d2d3-4168-8706-84c6e5e9c69d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.405995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111d727f542c48d3927eff92be1e7c31', 'request_id': 'req-98003fc8-d2d3-4168-8706-84c6e5e9c69d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.458556 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:25.459387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:25.459792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:25.460105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:25.491468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] The token cache is being invalidate because project 111d727f542c48d3927eff92be1e7c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:25.491760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.494742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.498016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1132/2260] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:25 2022] DELETE /identity/v3/projects/111d727f542c48d3927eff92be1e7c31 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:25.503443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:25.505738 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:25.555318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:25.557372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:25.573577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1129/2261] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:25.603538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003fc8-d2d3-4168-8706-84c6e5e9c69d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:25.609014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:25.609920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:25.610212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:25.610498 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] PATH_INFO: `/v3/users/1b31ae667cbf4aeea074e9a8c34e45a7` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:25.611726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b31ae667cbf4aeea074e9a8c34e45a7)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:25.613781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:25.687133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:25.689533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:25.707287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b63ab-f48d-4919-8122-2583578bcd14 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:25.713404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:25.714759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:25.714950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:25.715314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] PATH_INFO: `/v3/projects/42a8d22c51544db5a5b683f069f1d279` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:25.717957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a8d22c51544db5a5b683f069f1d279)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:25.720003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:25.837693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b31ae667cbf4aeea074e9a8c34e45a7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.840567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a8d22c51544db5a5b683f069f1d279', 'request_id': 'req-124d2912-4b54-4819-b1a2-1d5396119999'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.848531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b31ae667cbf4aeea074e9a8c34e45a7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.849268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b31ae667cbf4aeea074e9a8c34e45a7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.849923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b31ae667cbf4aeea074e9a8c34e45a7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.865116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b31ae667cbf4aeea074e9a8c34e45a7'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.917580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:25.975540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a8d22c51544db5a5b683f069f1d279', 'request_id': 'req-124d2912-4b54-4819-b1a2-1d5396119999'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.983346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a8d22c51544db5a5b683f069f1d279', 'request_id': 'req-124d2912-4b54-4819-b1a2-1d5396119999'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.995990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] The token cache is being invalidate because project 42a8d22c51544db5a5b683f069f1d279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:25.998659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.998659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:25.999346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1130/2262] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:25 2022] DELETE /identity/v3/projects/42a8d22c51544db5a5b683f069f1d279 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:26.003167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:26.004598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:26.043251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1133/2263] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:25 2022] DELETE /identity/v3/users/1b31ae667cbf4aeea074e9a8c34e45a7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:26.070586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d2912-4b54-4819-b1a2-1d5396119999 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:26.133595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:26.134872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:26.135264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:26.135690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] PATH_INFO: `/v3/users/125cadacc2634c7d9afea73bb8b2eea2` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:26.137176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125cadacc2634c7d9afea73bb8b2eea2)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:26.139921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:26.394253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125cadacc2634c7d9afea73bb8b2eea2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.401686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125cadacc2634c7d9afea73bb8b2eea2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.410822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125cadacc2634c7d9afea73bb8b2eea2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.410822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125cadacc2634c7d9afea73bb8b2eea2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.471855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125cadacc2634c7d9afea73bb8b2eea2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.490850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1131/2264] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:26 2022] DELETE /identity/v3/users/125cadacc2634c7d9afea73bb8b2eea2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:26.543342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:26.545813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:26.561449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e40fd7-fe92-442c-9c95-a5c971a7243d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:26.623866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:26.624739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:26.625028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:26.625346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] PATH_INFO: `/v3/projects/173e9b641d88440a9e4271141416681a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:26.626559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=173e9b641d88440a9e4271141416681a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:26.628495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:26.649081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:26.748858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173e9b641d88440a9e4271141416681a', 'request_id': 'req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.754484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173e9b641d88440a9e4271141416681a', 'request_id': 'req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.763852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173e9b641d88440a9e4271141416681a', 'request_id': 'req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.873474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] The token cache is being invalidate because project 173e9b641d88440a9e4271141416681a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:26.873771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.874471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:26.876080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1134/2265] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:26 2022] DELETE /identity/v3/projects/173e9b641d88440a9e4271141416681a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:26.880657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:26.882146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:26.895827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd939cd-ab6f-4bf3-ad9e-f838ca228919 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:26.918872 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:26.921324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:27.000785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.004778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.004778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.004778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] PATH_INFO: `/v3/users/cadd27af21ca4f45870f64c4990c7f5a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.004778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cadd27af21ca4f45870f64c4990c7f5a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.008341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.021146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b6bb-8147-4d5f-b134-4b7a270c1e2b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.026057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.027144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.028964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.028964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] PATH_INFO: `/v3/projects/672f8c501ac745f1a44c3d38c7b19f0e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.029200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672f8c501ac745f1a44c3d38c7b19f0e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.031282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.183046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cadd27af21ca4f45870f64c4990c7f5a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.183297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672f8c501ac745f1a44c3d38c7b19f0e', 'request_id': 'req-5b720564-87b9-499c-8191-d52d575beb00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.190109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672f8c501ac745f1a44c3d38c7b19f0e', 'request_id': 'req-5b720564-87b9-499c-8191-d52d575beb00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.191075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cadd27af21ca4f45870f64c4990c7f5a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.191779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cadd27af21ca4f45870f64c4990c7f5a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.192472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cadd27af21ca4f45870f64c4990c7f5a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.196377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672f8c501ac745f1a44c3d38c7b19f0e', 'request_id': 'req-5b720564-87b9-499c-8191-d52d575beb00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.272242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-29495813-d5e1-4131-bbfb-f645c783cb9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cadd27af21ca4f45870f64c4990c7f5a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.292788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1132/2266] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:26 2022] DELETE /identity/v3/users/cadd27af21ca4f45870f64c4990c7f5a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:27.346523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] The token cache is being invalidate because project 672f8c501ac745f1a44c3d38c7b19f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:27.346815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.347510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b720564-87b9-499c-8191-d52d575beb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.349267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1135/2267] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:26 2022] DELETE /identity/v3/projects/672f8c501ac745f1a44c3d38c7b19f0e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:27.356454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.356821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.357730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.378678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:27.379993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:27.459910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1133/2268] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:27.467930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.468221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.472057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.487821 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:27.489237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:27.502248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:27.512081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1136/2269] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:27.515232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:27.525319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568bd52-fb75-4fd5-8989-8255bb0867bc None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.530216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.530889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.531287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.531581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.532326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:27.532639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.534369 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.558436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1134/2270] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:27.564133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:27.573578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc620a0-2d76-443d-b03f-fe7d4561e855 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.578744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.579529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.579777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.580059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.580769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.582795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.690980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1137/2271] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:27 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:27.696527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:27.707660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85af20-f3da-459d-a8d1-e18425e01897 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.767448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.768132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.768423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.768706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.769461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.771404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.800554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:27.802437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:27.819878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183380a-3432-4998-87d4-cc80ec2fe728 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.826580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.827563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.827759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.828056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] PATH_INFO: `/v3/projects/d32817f31f164395be56f9a7c4899523` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.829413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32817f31f164395be56f9a7c4899523)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.831466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.870377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1135/2272] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:27 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:27.875283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:27.885615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156587a-337b-44ac-bf77-c6729b2c0574 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.891152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.891824 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.892109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.892392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.893127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.894786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:27.907141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1136/2273] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:27.911062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:27.922025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85477c3-efad-4ca4-a9e0-ef2789b37a02 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:27.932282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32817f31f164395be56f9a7c4899523', 'request_id': 'req-b22e7cef-3568-4c34-8b54-36394ab7a59c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.937952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32817f31f164395be56f9a7c4899523', 'request_id': 'req-b22e7cef-3568-4c34-8b54-36394ab7a59c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.948441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32817f31f164395be56f9a7c4899523', 'request_id': 'req-b22e7cef-3568-4c34-8b54-36394ab7a59c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:27.964331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:27.993855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:27.994541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:27.994849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:27.995137 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:27.995867 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:27.997733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.008986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1137/2274] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:28.014750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.026191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] The token cache is being invalidate because project d32817f31f164395be56f9a7c4899523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:28.026457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:28.027242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-b22e7cef-3568-4c34-8b54-36394ab7a59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:28.028288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8b4b2-794a-4c52-bba7-26d566fc88c0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.028920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1138/2275] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:27 2022] DELETE /identity/v3/projects/d32817f31f164395be56f9a7c4899523 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:28.035661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ff33-f6c2-4e8a-8275-6bd6205a52d8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.036044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ff33-f6c2-4e8a-8275-6bd6205a52d8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.036600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ff33-f6c2-4e8a-8275-6bd6205a52d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.038159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c06717-8f35-4710-ae45-c9216c6a2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.039115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06717-8f35-4710-ae45-c9216c6a2b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.039400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06717-8f35-4710-ae45-c9216c6a2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.039682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06717-8f35-4710-ae45-c9216c6a2b56 admin admin] PATH_INFO: `/v3/projects/681d6a1027654de0acb3378056cc7c1d/users/29336ad794d54d979a260fe62a487aee/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.058107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-27b2ff33-f6c2-4e8a-8275-6bd6205a52d8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:28.059264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c06717-8f35-4710-ae45-c9216c6a2b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681d6a1027654de0acb3378056cc7c1d, user_id=29336ad794d54d979a260fe62a487aee, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.059473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-27b2ff33-f6c2-4e8a-8275-6bd6205a52d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:28.062445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c06717-8f35-4710-ae45-c9216c6a2b56 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.070067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1139/2276] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:28.078054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.078348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.078630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.105148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:28.106418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:28.115329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1140/2277] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:28.119932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.131296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7128904-1ffd-46e1-b126-61c82df3bb06 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.134634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1138/2278] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:28 2022] PUT /identity/v3/projects/681d6a1027654de0acb3378056cc7c1d/users/29336ad794d54d979a260fe62a487aee/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:28.150371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:28.151883 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.152171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.152459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.191354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] MFA Rules not processed for user `29336ad794d54d979a260fe62a487aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:28.192706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:28.227066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.228188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.228484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.228845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.229843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:28.230747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.232196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.252551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1141/2279] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:50:28.257396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.280287 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafed0a-8e32-4960-8ed3-bf663204dd64 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.283927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1139/2280] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:28.286178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.286410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.286905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.287194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.287516 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.287906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:28.288750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.290716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.304095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abd886-0a56-4c7a-88a4-6f833c6a3bf1 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.310090 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.310656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.311684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.312226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.313722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.316000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.384993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1142/2281] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:28.389888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.406294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1140/2282] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:28.410344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.472112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c5bb-9628-4676-aef7-b155121dc48f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.476061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:28.512899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96263eab-6d76-4ed8-a553-cf857736594d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.522037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.523110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.523569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.524026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.525304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.528665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.537593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:28.543271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.543954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.544246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.544530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.545490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.547573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.661574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1141/2283] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:28.665728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.677604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bc74a-b87c-4288-952b-f6eb11c41600 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.683378 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.684046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.684335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.684612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.685938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.688149 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.697257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1143/2284] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/users => generated 284 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:28.699297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1142/2285] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:28.702534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.704636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.712983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad09f0-51a3-4c15-8626-43f4560525e0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.714655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee1f02-cdb2-418a-b425-7ae06c41a650 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.719233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.719914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.720201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.720481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.721038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.721313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.722925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.723052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.723315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.723603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] PATH_INFO: `/v3/projects/8de0d0762d1543ccb020c2906eca874a/users/ce222d83c4a5496a949fe239db2340b9/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.735439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1144/2286] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:28.739444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.741120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de0d0762d1543ccb020c2906eca874a, user_id=ce222d83c4a5496a949fe239db2340b9, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.743951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.750537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998fbfe-6aee-4b2d-ac84-941f99840302 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.756110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.766748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.766748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.766748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.766748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.766748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.776633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1145/2287] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:28.782328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.792966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce928732-aa23-4ef0-a364-d151e16da138 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.798017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf049e-7b6b-478a-a497-8a742a59a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.798907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf049e-7b6b-478a-a497-8a742a59a5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.799186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf049e-7b6b-478a-a497-8a742a59a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.799460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf049e-7b6b-478a-a497-8a742a59a5bb admin admin] PATH_INFO: `/v3/projects/6d43e2910352432b9b410962c0b2b021/users/cd3f8b7fdfc648deb8b39e41f449fde6/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.815190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf049e-7b6b-478a-a497-8a742a59a5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d43e2910352432b9b410962c0b2b021, user_id=cd3f8b7fdfc648deb8b39e41f449fde6, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.818060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf049e-7b6b-478a-a497-8a742a59a5bb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.834553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1143/2288] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:28 2022] PUT /identity/v3/projects/8de0d0762d1543ccb020c2906eca874a/users/ce222d83c4a5496a949fe239db2340b9/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:28.838535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.864662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:28.909253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f614e1f-4a49-41b1-81c8-d314eeafb473 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.913951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:28.914564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.914860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.915240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.915970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:28.917637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:28.934604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1144/2289] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:28.938899 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1146/2290] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:28 2022] PUT /identity/v3/projects/6d43e2910352432b9b410962c0b2b021/users/cd3f8b7fdfc648deb8b39e41f449fde6/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:28.945506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:28.948876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:28.949168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:28.949340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf4c3-1ac3-4d33-9e90-f0f0658b710e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:28.949476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:28.979848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] MFA Rules not processed for user `cd3f8b7fdfc648deb8b39e41f449fde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:28.981075 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:29.000932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:29.018623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08624041-1321-49ce-914a-61d46bd6cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:29.019625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08624041-1321-49ce-914a-61d46bd6cf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:29.019912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08624041-1321-49ce-914a-61d46bd6cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:29.020195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08624041-1321-49ce-914a-61d46bd6cf48 admin admin] PATH_INFO: `/v3/projects/8de0d0762d1543ccb020c2906eca874a/users/ce222d83c4a5496a949fe239db2340b9/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:29.023075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08624041-1321-49ce-914a-61d46bd6cf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de0d0762d1543ccb020c2906eca874a, user_id=ce222d83c4a5496a949fe239db2340b9, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:29.026352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08624041-1321-49ce-914a-61d46bd6cf48 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:29.037338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1145/2291] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:28 2022] PUT /identity/v3/projects/8de0d0762d1543ccb020c2906eca874a/users/ce222d83c4a5496a949fe239db2340b9/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:29.049311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:29.049642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:29.049930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:29.061225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1147/2292] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:29.080070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] MFA Rules not processed for user `ce222d83c4a5496a949fe239db2340b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:29.080329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:29.081348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:29.082701 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:29.161431 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142509-9ce2-4286-9817-52e9361424d4 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:29.163585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1146/2293] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:29.175356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:29.176855 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:29.220538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd84f1-53bd-4726-ba64-2c59a2125fe3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:29.221624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd84f1-53bd-4726-ba64-2c59a2125fe3 service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:29.222097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd84f1-53bd-4726-ba64-2c59a2125fe3 service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:29.222604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd84f1-53bd-4726-ba64-2c59a2125fe3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:29.256214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfafc6-e441-43c0-9124-75aab84c3e6a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:29.260380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:29.261010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:29.261314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:29.261603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:29.271791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:29.273264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:29.285675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1147/2294] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:29.309531 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd84f1-53bd-4726-ba64-2c59a2125fe3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:29.311475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd84f1-53bd-4726-ba64-2c59a2125fe3 service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:29.322395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1148/2295] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:29.346141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:29.348386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:29.365523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f799b63-b278-4836-a60a-bf77d3cad74d service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:29.371692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:29.372787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:29.373376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:29.375735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:29.396386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:29.445306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:29.464419 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:29.465955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:29.476802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1148/2296] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:50:29.553537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:29.724029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:29.941014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:30.164017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beaac1-29c2-4d85-9502-c49b0be96f58 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:30.164315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beaac1-29c2-4d85-9502-c49b0be96f58 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:30.164607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9beaac1-29c2-4d85-9502-c49b0be96f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:30.183355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a9beaac1-29c2-4d85-9502-c49b0be96f58 None None] MFA Rules not processed for user `127c04cf84664a7582853dec90f130b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:30.184593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a9beaac1-29c2-4d85-9502-c49b0be96f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:30.255544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1149/2297] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:30.273074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:30.810153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:31.079105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:31.313146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:32.227676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:32.376147 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:33.101553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:33.176166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:33.593421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:33.822636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:34.250788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:34.410638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:34.449866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:34.533016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beaf54-9300-4ca0-960c-a9401fc5e4a4 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:34.537808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18077577-9637-4857-a625-941643cd17cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:34.538694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077577-9637-4857-a625-941643cd17cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:34.538981 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077577-9637-4857-a625-941643cd17cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:34.539262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077577-9637-4857-a625-941643cd17cf admin admin] PATH_INFO: `/v3/users/29336ad794d54d979a260fe62a487aee` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:34.540493 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18077577-9637-4857-a625-941643cd17cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=29336ad794d54d979a260fe62a487aee)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:34.542457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18077577-9637-4857-a625-941643cd17cf admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:34.784205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29336ad794d54d979a260fe62a487aee'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:34.792399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29336ad794d54d979a260fe62a487aee'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:34.793189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29336ad794d54d979a260fe62a487aee'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:34.793908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29336ad794d54d979a260fe62a487aee'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:34.872910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29336ad794d54d979a260fe62a487aee'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:34.894276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1149/2298] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:34 2022] DELETE /identity/v3/users/29336ad794d54d979a260fe62a487aee => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:34.898609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:34.899150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:34.901480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:34.927848 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:34.929486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:35.005801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1150/2299] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:35.018866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:35.020664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:35.044724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:35.047512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:35.062816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab19db-db6c-470f-b2b0-cafd689e239a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:35.067792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:35.068663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:35.068946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:35.069219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] PATH_INFO: `/v3/users/1013248590ac430bb2843198b1f9b503` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:35.070819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1013248590ac430bb2843198b1f9b503)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:35.072975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:35.080900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:35.084892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:35.096861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18077577-9637-4857-a625-941643cd17cf admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:35.107270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0422ef3-ed92-471a-9d70-d8e67d0a23b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:35.108968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422ef3-ed92-471a-9d70-d8e67d0a23b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:35.109617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422ef3-ed92-471a-9d70-d8e67d0a23b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:35.110118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422ef3-ed92-471a-9d70-d8e67d0a23b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:35.122009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0422ef3-ed92-471a-9d70-d8e67d0a23b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:35.124773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0422ef3-ed92-471a-9d70-d8e67d0a23b4 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:35.136651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1150/2300] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:35.287205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1013248590ac430bb2843198b1f9b503'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.296861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1013248590ac430bb2843198b1f9b503'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.297840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1013248590ac430bb2843198b1f9b503'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.298585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1013248590ac430bb2843198b1f9b503'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.311806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1013248590ac430bb2843198b1f9b503'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.406276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1151/2301] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:35 2022] DELETE /identity/v3/users/1013248590ac430bb2843198b1f9b503 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:35.411032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:35.411329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:35.411618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:35.430271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:35.431688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:35.521498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1151/2302] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:50:35.532724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:35.536272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:35.610774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:35.636419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd989fc6-327c-49f9-b01c-90e82053c243 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:35.641846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:35.643264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:35.643561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:35.648378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:35.654983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:35.656998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:35.667606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1152/2303] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:35.716244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:35.718622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:35.732328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3571fb-3ce3-43f2-9911-86d9749b4fea None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:35.739952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:35.740930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:35.741222 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:35.741554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] PATH_INFO: `/v3/projects/681d6a1027654de0acb3378056cc7c1d` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:35.753897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] RBAC: Authorizing `identity:delete_project(project_id=681d6a1027654de0acb3378056cc7c1d)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:35.756044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:35.893477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681d6a1027654de0acb3378056cc7c1d', 'request_id': 'req-822cb83a-01d5-4363-8320-902c0f0c282b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.930771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:35.954487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681d6a1027654de0acb3378056cc7c1d', 'request_id': 'req-822cb83a-01d5-4363-8320-902c0f0c282b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.961797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681d6a1027654de0acb3378056cc7c1d', 'request_id': 'req-822cb83a-01d5-4363-8320-902c0f0c282b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.976810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] The token cache is being invalidate because project 681d6a1027654de0acb3378056cc7c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:35.977241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.978026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:35.979983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1152/2304] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:35 2022] DELETE /identity/v3/projects/681d6a1027654de0acb3378056cc7c1d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:35.984104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:35.994305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaaf8b-06cf-4cc7-bcff-4feefea5c3d4 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:36.065963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:36.066766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:36.067057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:36.067338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] PATH_INFO: `/v3/users/ce222d83c4a5496a949fe239db2340b9` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:36.068557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce222d83c4a5496a949fe239db2340b9)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:36.070541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:36.098718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:36.103732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:36.118382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb83a-01d5-4363-8320-902c0f0c282b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:36.124587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:36.125528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:36.125812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:36.128732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] PATH_INFO: `/v3/projects/62e463f8e83442e0b7a2f1ce15ae90a7` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:36.130361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e463f8e83442e0b7a2f1ce15ae90a7)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:36.132593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:36.365594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce222d83c4a5496a949fe239db2340b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.373201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce222d83c4a5496a949fe239db2340b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.374511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce222d83c4a5496a949fe239db2340b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.375684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce222d83c4a5496a949fe239db2340b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.394749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e463f8e83442e0b7a2f1ce15ae90a7', 'request_id': 'req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.396732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce222d83c4a5496a949fe239db2340b9'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.495864 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1153/2305] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:35 2022] DELETE /identity/v3/users/ce222d83c4a5496a949fe239db2340b9 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:36.550136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e463f8e83442e0b7a2f1ce15ae90a7', 'request_id': 'req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.558319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:36.561001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e463f8e83442e0b7a2f1ce15ae90a7', 'request_id': 'req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.575099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] The token cache is being invalidate because project 62e463f8e83442e0b7a2f1ce15ae90a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:36.575391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.576150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ba936aae-4c6f-4bb5-8388-c2f58ac80d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:36.578291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1153/2306] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:36 2022] DELETE /identity/v3/projects/62e463f8e83442e0b7a2f1ce15ae90a7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:37.008666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.010509 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:37.073097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:37.099245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca977b2-6025-47e2-a20e-493cffb457c2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.104483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.105475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.105831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.106184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] PATH_INFO: `/v3/projects/8de0d0762d1543ccb020c2906eca874a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.107476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de0d0762d1543ccb020c2906eca874a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.110218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:37.251556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de0d0762d1543ccb020c2906eca874a', 'request_id': 'req-aa73d7b3-efe7-4917-8f0f-e07e1e598136'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:37.267341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de0d0762d1543ccb020c2906eca874a', 'request_id': 'req-aa73d7b3-efe7-4917-8f0f-e07e1e598136'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:37.274452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de0d0762d1543ccb020c2906eca874a', 'request_id': 'req-aa73d7b3-efe7-4917-8f0f-e07e1e598136'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:37.387227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] The token cache is being invalidate because project 8de0d0762d1543ccb020c2906eca874a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:37.387439 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:37.388074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-aa73d7b3-efe7-4917-8f0f-e07e1e598136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:37.390606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1154/2307] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:37 2022] DELETE /identity/v3/projects/8de0d0762d1543ccb020c2906eca874a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:37.395268 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.395763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.395871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.416377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:37.417627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:37.479742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1154/2308] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:37.487811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.488107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.488372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.508314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:37.509564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:37.518273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1155/2309] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:37.522525 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.532777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41501-b002-48a0-b079-cf962134eb60 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.537515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.538194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.538478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.538752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.539498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:37.539788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.541943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:37.557723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1155/2310] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:37.559556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.569801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93642ba5-ee72-4e10-99fd-40496741da03 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.574476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.575136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.575429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.575711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.576414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.579018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:37.652293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1156/2311] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:37 2022] POST /identity/v3/projects => generated 409 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:37.656681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.666862 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b5f1-45a6-4dbe-a072-0294e40a8680 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.732372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.733052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.733464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.734212 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.734912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.736843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:37.839568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1156/2312] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:37 2022] POST /identity/v3/users => generated 305 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:37.840895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.852788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415d63a-c65e-448e-8b4c-5b981489230b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.858085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.859339 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.859674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.859951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.860686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.862343 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:37.877345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1157/2313] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:37.878687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.889088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fdbe9-a51f-4a7c-808e-c060f9bd1dc6 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.894482 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ff909-7b9a-4501-af4a-956ab2f9e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.895164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff909-7b9a-4501-af4a-956ab2f9e4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.895452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff909-7b9a-4501-af4a-956ab2f9e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.895735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ff909-7b9a-4501-af4a-956ab2f9e4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.896478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ff909-7b9a-4501-af4a-956ab2f9e4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.898140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ff909-7b9a-4501-af4a-956ab2f9e4bf admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:37.909791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1157/2314] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:37.914302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:37.925398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6c221-16f1-48d5-83a9-7f90493c6693 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:37.930029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:37.930906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:37.931189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:37.931514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] PATH_INFO: `/v3/projects/74180eb84f8547c994bbd76294396fa9/users/4afcdb159de64ad59249638c5bda1c92/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:37.948772 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74180eb84f8547c994bbd76294396fa9, user_id=4afcdb159de64ad59249638c5bda1c92, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:37.951517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.035134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1158/2315] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:37 2022] PUT /identity/v3/projects/74180eb84f8547c994bbd76294396fa9/users/4afcdb159de64ad59249638c5bda1c92/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:38.045406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.045700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.046476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.075354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] MFA Rules not processed for user `4afcdb159de64ad59249638c5bda1c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:38.077915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:38.127487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:38.148794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1158/2316] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:38.153798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:38.222281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9d83a-5f09-4ad8-9759-0467b10c5ed9 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:38.227204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:38.227876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.231483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.231483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.231483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:38.231483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.244315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:38.409798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1159/2317] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:38 2022] POST /identity/v3/projects => generated 409 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:38.410988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:38.422453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383e085-f0db-4827-bf81-73d0f88b969e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:38.478546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:38.479396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.479788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.480074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.480769 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:38.482715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.605951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1159/2318] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:38 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:38.610497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:38.621219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f059a-57e2-499e-b059-245e8663dd34 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:38.626538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:38.627227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.627528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.627814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.628577 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:38.630263 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.643215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1160/2319] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:38.647548 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:38.658234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf70e-109e-463e-9239-a5bceb98f8d6 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:38.662764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:38.663635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.663923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.664201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] PATH_INFO: `/v3/projects/89e440dc568c463db5bab029afe1ec96/users/6c0129535fc649c197b9d8621c94827b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.679194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e440dc568c463db5bab029afe1ec96, user_id=6c0129535fc649c197b9d8621c94827b, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:38.681923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.774850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1160/2320] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:38 2022] PUT /identity/v3/projects/89e440dc568c463db5bab029afe1ec96/users/6c0129535fc649c197b9d8621c94827b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:38.778700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:38.790238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b47706-6b7b-440a-a246-f281e62ee383 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:38.851068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a733225-7e79-469c-aa64-04fa110c80de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:38.853666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733225-7e79-469c-aa64-04fa110c80de admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.853666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733225-7e79-469c-aa64-04fa110c80de admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.853666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733225-7e79-469c-aa64-04fa110c80de admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.853666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733225-7e79-469c-aa64-04fa110c80de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:38.855008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733225-7e79-469c-aa64-04fa110c80de admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.865656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1161/2321] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:38.869880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:38.880787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e59f-33f9-4446-887a-72fe14ecda0f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:38.885615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:38.886498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.886786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.887066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] PATH_INFO: `/v3/projects/89e440dc568c463db5bab029afe1ec96/users/6c0129535fc649c197b9d8621c94827b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.889041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e440dc568c463db5bab029afe1ec96, user_id=6c0129535fc649c197b9d8621c94827b, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:38.892260 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:38.903838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1161/2322] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:38 2022] PUT /identity/v3/projects/89e440dc568c463db5bab029afe1ec96/users/6c0129535fc649c197b9d8621c94827b/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:38.921006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:38.921313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:38.921610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:38.948729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] MFA Rules not processed for user `6c0129535fc649c197b9d8621c94827b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:38.950081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:39.022586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1162/2323] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:39.034888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:39.036784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:39.098878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02e5ad-f98c-4d5c-8c72-92a1eae418dc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:39.102766 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:39.103432 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:39.103722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:39.104005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:39.114232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:39.115800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:39.129007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1162/2324] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:39.526050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:39.527508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:39.540215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0ce20-ad63-428b-beaf-3be973460a96 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:39.544119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135377f2-5319-4626-bf9c-40c558fa0806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:39.544865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135377f2-5319-4626-bf9c-40c558fa0806 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:39.545221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135377f2-5319-4626-bf9c-40c558fa0806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:39.545540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135377f2-5319-4626-bf9c-40c558fa0806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:39.614214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135377f2-5319-4626-bf9c-40c558fa0806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:39.615672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135377f2-5319-4626-bf9c-40c558fa0806 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:39.620710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:39.626776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1163/2325] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:49.123715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:49.920659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:50.030568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4382180-08b0-4699-88b7-339e3f64c109 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:50.035334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:50.036197 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:50.036434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:50.036718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] PATH_INFO: `/v3/users/4afcdb159de64ad59249638c5bda1c92` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:50.037919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afcdb159de64ad59249638c5bda1c92)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:50.039839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:50.275269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afcdb159de64ad59249638c5bda1c92'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:50.284055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afcdb159de64ad59249638c5bda1c92'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:50.284763 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afcdb159de64ad59249638c5bda1c92'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:50.285593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afcdb159de64ad59249638c5bda1c92'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:50.342964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afcdb159de64ad59249638c5bda1c92'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:50.363420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1163/2326] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:49 2022] DELETE /identity/v3/users/4afcdb159de64ad59249638c5bda1c92 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:50.368566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:50.368566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:50.368566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:50.427669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:50.428888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:50.492615 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1164/2327] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:50.502586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:50.504042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:50.546141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:50.600991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785ba4-8774-4e6e-a63b-d308171820d0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:50.604751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:50.605451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:50.605746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:50.606288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:50.617994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:50.619550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:50.632853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1164/2328] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:51.170024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:51.171797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:51.188018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827c97-1653-41f1-96ce-02561a38ba51 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:51.193652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:51.194678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:51.195031 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:51.195381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] PATH_INFO: `/v3/projects/74180eb84f8547c994bbd76294396fa9` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:51.196680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74180eb84f8547c994bbd76294396fa9)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:51.198892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:51.314466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74180eb84f8547c994bbd76294396fa9', 'request_id': 'req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.323160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74180eb84f8547c994bbd76294396fa9', 'request_id': 'req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.332598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74180eb84f8547c994bbd76294396fa9', 'request_id': 'req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.405793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] The token cache is being invalidate because project 74180eb84f8547c994bbd76294396fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:51.406472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.406643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.408830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1165/2329] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:51 2022] DELETE /identity/v3/projects/74180eb84f8547c994bbd76294396fa9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:50:51.413430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:51.424058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c657e-429d-4d89-81ab-210716589ffe service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:51.488686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:51.489759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:51.490083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:51.490685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] PATH_INFO: `/v3/users/6c0129535fc649c197b9d8621c94827b` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:51.492689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0129535fc649c197b9d8621c94827b)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:51.494745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:51.721722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0129535fc649c197b9d8621c94827b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.730179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0129535fc649c197b9d8621c94827b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.731416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0129535fc649c197b9d8621c94827b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.736381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0129535fc649c197b9d8621c94827b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.794990 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a9f26d8e-3d63-4708-b990-49a105e7b00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0129535fc649c197b9d8621c94827b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:51.818872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1165/2330] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:50:51 2022] DELETE /identity/v3/users/6c0129535fc649c197b9d8621c94827b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:52.425406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:52.429534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:52.442935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1e1e-621d-45d5-bee0-a41e63aa3903 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:52.497940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:52.504008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:52.504877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:52.505167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:52.505481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] PATH_INFO: `/v3/projects/89e440dc568c463db5bab029afe1ec96` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:52.506661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e440dc568c463db5bab029afe1ec96)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:52.508584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:52.608626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e440dc568c463db5bab029afe1ec96', 'request_id': 'req-3b5253b1-fd41-4361-b70b-083e3d70b521'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:52.614499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e440dc568c463db5bab029afe1ec96', 'request_id': 'req-3b5253b1-fd41-4361-b70b-083e3d70b521'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:52.620774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e440dc568c463db5bab029afe1ec96', 'request_id': 'req-3b5253b1-fd41-4361-b70b-083e3d70b521'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:52.696976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] The token cache is being invalidate because project 89e440dc568c463db5bab029afe1ec96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:50:52.697266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:52.697914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b5253b1-fd41-4361-b70b-083e3d70b521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:50:52.699453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1166/2331] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:50:52 2022] DELETE /identity/v3/projects/89e440dc568c463db5bab029afe1ec96 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:52.704911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12812-79cb-4483-a857-155f2408e993 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:52.705458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12812-79cb-4483-a857-155f2408e993 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:52.705458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12812-79cb-4483-a857-155f2408e993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:52.750206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-33e12812-79cb-4483-a857-155f2408e993 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:52.751625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-33e12812-79cb-4483-a857-155f2408e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:52.756139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:52.829253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1166/2332] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:52.830998 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:52.831299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:52.831587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:52.852293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:52.853695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:52.862337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1167/2333] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:52.866550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e12812-79cb-4483-a857-155f2408e993 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:52.876863 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e12812-79cb-4483-a857-155f2408e993 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:52.885772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:52.886560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:52.886910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:52.887256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:52.888230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:50:52.888609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:52.890346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:52.903976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1167/2334] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:50:52.908921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:52.918151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e5552-4a05-4a64-ab57-e1cb85ea1019 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:52.922837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:52.923511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:52.923685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:52.923961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:52.924660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:52.926588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.005176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1168/2335] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:52 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:53.009321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.019798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b433b9-31da-4567-93a2-bc02cca4c58f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.079688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.080366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.080660 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.080944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.081688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.083611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.217016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1168/2336] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:53 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:53.218756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.230827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405158a-ca53-4364-9931-8c6aae5a8599 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.236361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.237032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.237356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.237638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.238375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.239989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.251775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1169/2337] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:53.255742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.266652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3251-2b5a-4ac5-8121-f46e34f5a11c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.271391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9417b6-c77d-4d6c-aa91-94b9bdf0df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.272086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9417b6-c77d-4d6c-aa91-94b9bdf0df3e admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.272370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9417b6-c77d-4d6c-aa91-94b9bdf0df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.272646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9417b6-c77d-4d6c-aa91-94b9bdf0df3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.273400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9417b6-c77d-4d6c-aa91-94b9bdf0df3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.275005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9417b6-c77d-4d6c-aa91-94b9bdf0df3e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.286209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1169/2338] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:53.290461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.302042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432c0a8-7323-4285-9714-4ed0b9e24c5c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.306640 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.307538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.307824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.308104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] PATH_INFO: `/v3/projects/0f80a4c9a7af4eacb568d9523834b202/users/a31a16aff88640be91e589f8ed3beeb2/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.332285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f80a4c9a7af4eacb568d9523834b202, user_id=a31a16aff88640be91e589f8ed3beeb2, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.335013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.396001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1170/2339] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:53 2022] PUT /identity/v3/projects/0f80a4c9a7af4eacb568d9523834b202/users/a31a16aff88640be91e589f8ed3beeb2/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:53.407614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.407948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.408281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.434366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] MFA Rules not processed for user `a31a16aff88640be91e589f8ed3beeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:53.435664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:53.500579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1170/2340] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:53.504968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.567104 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79648a-05e0-4382-9bac-173572cdec06 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.571975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.572629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.572915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.573195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.574086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.575984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.648009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1171/2341] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:50:53 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:50:53.652058 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.659801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:53.664377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d617338-55be-4dcd-b9ab-c845c0130135 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.722207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.722885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.723161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.723445 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.724152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.726104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.812015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1171/2342] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:50:53 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:50:53.816472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.826717 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ae66b-d8c8-44a7-a20b-8ddf521787af admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.832436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.833084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.833425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.833700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.834447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.836044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:53.838254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:53.847448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1172/2343] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:50:53.851704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:53.862172 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34849b5-67a1-4270-8681-e66af5e99869 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:53.867076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:53.867961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:53.868246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:53.868524 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] PATH_INFO: `/v3/projects/37eed9f8fe9742bb8336efcd48231eb2/users/53c42b3278c84d29a8093449c850e51e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:53.884721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37eed9f8fe9742bb8336efcd48231eb2, user_id=53c42b3278c84d29a8093449c850e51e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:53.887411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:54.027327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1172/2344] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:53 2022] PUT /identity/v3/projects/37eed9f8fe9742bb8336efcd48231eb2/users/53c42b3278c84d29a8093449c850e51e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:54.040291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:54.042462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35fb2-1131-43e0-b3c3-a39a0aacce7d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:54.100680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248e927-a089-40e3-8ab7-b61c562e46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:54.101270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248e927-a089-40e3-8ab7-b61c562e46fe admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:54.101587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248e927-a089-40e3-8ab7-b61c562e46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:54.101873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248e927-a089-40e3-8ab7-b61c562e46fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:54.102603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248e927-a089-40e3-8ab7-b61c562e46fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:54.104273 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248e927-a089-40e3-8ab7-b61c562e46fe admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:54.115755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1173/2345] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:50:54.126616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:54.130916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340cd7c-14ff-42d9-bb8a-737a8e651e7b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:54.135413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:54.136284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:54.136567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:54.136842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] PATH_INFO: `/v3/projects/37eed9f8fe9742bb8336efcd48231eb2/users/53c42b3278c84d29a8093449c850e51e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:54.138812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37eed9f8fe9742bb8336efcd48231eb2, user_id=53c42b3278c84d29a8093449c850e51e, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:54.141503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:54.151866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1173/2346] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:50:54 2022] PUT /identity/v3/projects/37eed9f8fe9742bb8336efcd48231eb2/users/53c42b3278c84d29a8093449c850e51e/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:50:54.169375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e19c5-2767-4dbb-8570-595004b359f7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:54.169678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e19c5-2767-4dbb-8570-595004b359f7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:54.169972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e19c5-2767-4dbb-8570-595004b359f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:54.197432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-319e19c5-2767-4dbb-8570-595004b359f7 None None] MFA Rules not processed for user `53c42b3278c84d29a8093449c850e51e`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:54.198656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-319e19c5-2767-4dbb-8570-595004b359f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:54.274664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1174/2347] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:50:54.282285 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:50:54.283970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:54.354156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094746df-d78f-4fea-b9d6-87a41ea77b57 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:50:54.358443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:50:54.360505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:54.361024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:54.361721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:54.434287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:50:54.435576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:50:54.446002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1174/2348] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:50:59.161834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ed1a9-b913-442f-8974-ad5f2c0c0231 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:50:59.162319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ed1a9-b913-442f-8974-ad5f2c0c0231 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:50:59.162814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ed1a9-b913-442f-8974-ad5f2c0c0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:50:59.181186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-100ed1a9-b913-442f-8974-ad5f2c0c0231 None None] MFA Rules not processed for user `127c04cf84664a7582853dec90f130b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:50:59.182644 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-100ed1a9-b913-442f-8974-ad5f2c0c0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:50:59.246278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1175/2349] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:50:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:01.514262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:01.524122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f6b53-524a-4300-ad90-d2b7d806d50d service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:01.527952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d6737-d051-4663-b64c-b181a6127e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:01.528604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d6737-d051-4663-b64c-b181a6127e15 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:01.528914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d6737-d051-4663-b64c-b181a6127e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:01.529198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d6737-d051-4663-b64c-b181a6127e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:01.540005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d6737-d051-4663-b64c-b181a6127e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:01.541457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d6737-d051-4663-b64c-b181a6127e15 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:01.545435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:01.553069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1175/2350] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:03.764054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:03.764470 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:03.764623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:03.783111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] MFA Rules not processed for user `f45384380b364e60823101515b359ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:03.784898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:03.807249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:03.845029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1176/2351] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:05.852145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:05.852640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:05.852847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:05.885539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:05.887021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:06.017966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1176/2352] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:06.076689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:06.078831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:06.219525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a4cb4-97bc-414b-b989-f13eaa89004e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:06.232518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa22c8a-2c64-4bed-8df9-87a0f17cb1f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:06.235925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22c8a-2c64-4bed-8df9-87a0f17cb1f0 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:06.236418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22c8a-2c64-4bed-8df9-87a0f17cb1f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:06.236877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22c8a-2c64-4bed-8df9-87a0f17cb1f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:06.248173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa22c8a-2c64-4bed-8df9-87a0f17cb1f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:06.250030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa22c8a-2c64-4bed-8df9-87a0f17cb1f0 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:06.264857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1177/2353] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:51:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:51:10.483080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:10.657596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1194ef-43f7-4014-8a5c-e336f7564101 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:10.668074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:10.668992 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:10.669337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:10.669598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] PATH_INFO: `/v3/users/a31a16aff88640be91e589f8ed3beeb2` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:10.671052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31a16aff88640be91e589f8ed3beeb2)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:10.673066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:11.014995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31a16aff88640be91e589f8ed3beeb2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:11.033253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31a16aff88640be91e589f8ed3beeb2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:11.034578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31a16aff88640be91e589f8ed3beeb2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:11.035370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31a16aff88640be91e589f8ed3beeb2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:11.186249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31a16aff88640be91e589f8ed3beeb2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:11.234538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1177/2354] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:51:10 2022] DELETE /identity/v3/users/a31a16aff88640be91e589f8ed3beeb2 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:11.243605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:11.244206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:11.244206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:11.263174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:11.268633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:11.349005 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1178/2355] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:11.359452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:11.361170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:11.374909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:11.463886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee03c9-43e5-45b0-8cac-3054ff17aef3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:11.473050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:11.473793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:11.474132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:11.474426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:11.486263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:11.490294 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:11.513519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1178/2356] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:12.112857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:12.114610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:12.133870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95f9e-40a3-404c-baff-0ac97308c3a2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:12.140982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:12.142650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:12.146905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:12.147468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] PATH_INFO: `/v3/users/cd3f8b7fdfc648deb8b39e41f449fde6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:12.151264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3f8b7fdfc648deb8b39e41f449fde6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:12.156402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:12.226646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:12.226646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:12.277735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677bfff-384e-45a7-9787-da6fa4acf6ae service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:12.291027 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:12.292434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:12.292793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:12.293148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] PATH_INFO: `/v3/projects/0f80a4c9a7af4eacb568d9523834b202` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:12.296566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f80a4c9a7af4eacb568d9523834b202)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:12.300189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:12.343839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3f8b7fdfc648deb8b39e41f449fde6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.376063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:12.378149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3f8b7fdfc648deb8b39e41f449fde6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.381700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3f8b7fdfc648deb8b39e41f449fde6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.384159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3f8b7fdfc648deb8b39e41f449fde6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.405638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-75d92fef-a061-4fc2-b427-ca4c4d9dce20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3f8b7fdfc648deb8b39e41f449fde6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.491582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1179/2357] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:51:12 2022] DELETE /identity/v3/users/cd3f8b7fdfc648deb8b39e41f449fde6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:12.497317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:12.497317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:12.497634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:12.524318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f80a4c9a7af4eacb568d9523834b202', 'request_id': 'req-f9be2e67-8e3e-4e73-a213-5a36555258bd'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.544170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:12.545949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:12.621685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f80a4c9a7af4eacb568d9523834b202', 'request_id': 'req-f9be2e67-8e3e-4e73-a213-5a36555258bd'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.631359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f80a4c9a7af4eacb568d9523834b202', 'request_id': 'req-f9be2e67-8e3e-4e73-a213-5a36555258bd'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.658476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] The token cache is being invalidate because project 0f80a4c9a7af4eacb568d9523834b202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:51:12.659614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.663844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:12.667367 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1179/2358] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:51:12 2022] DELETE /identity/v3/projects/0f80a4c9a7af4eacb568d9523834b202 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:51:12.672826 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:12.677226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:12.683007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1180/2359] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:51:12.694496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:12.695937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:12.789706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be2e67-8e3e-4e73-a213-5a36555258bd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:12.804603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:12.805941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:12.806330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:12.806715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] PATH_INFO: `/v3/users/53c42b3278c84d29a8093449c850e51e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:12.808536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c42b3278c84d29a8093449c850e51e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:12.810716 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:12.844971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d071b7-abac-4012-8fb9-2f1b2937ca40 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:12.859609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:12.860296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:12.860586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:12.860871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:12.875756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:12.877220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:12.888750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1181/2360] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:51:13.051694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:13.067413 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c42b3278c84d29a8093449c850e51e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:13.076287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c42b3278c84d29a8093449c850e51e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:13.077129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c42b3278c84d29a8093449c850e51e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:13.080764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c42b3278c84d29a8093449c850e51e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:13.205919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c42b3278c84d29a8093449c850e51e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:13.235008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1180/2361] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:51:12 2022] DELETE /identity/v3/users/53c42b3278c84d29a8093449c850e51e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:13.708904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:13.710779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:13.740008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628834c-32eb-4bf6-8ea3-1f5e380b50f2 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:13.870133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:13.871234 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:13.871598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:13.871951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] PATH_INFO: `/v3/projects/6d43e2910352432b9b410962c0b2b021` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:13.875421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d43e2910352432b9b410962c0b2b021)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:13.880355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:13.926401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:14.047041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d43e2910352432b9b410962c0b2b021', 'request_id': 'req-f122ecf1-a74c-4877-a290-568544d6d2f2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.054361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d43e2910352432b9b410962c0b2b021', 'request_id': 'req-f122ecf1-a74c-4877-a290-568544d6d2f2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.061912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d43e2910352432b9b410962c0b2b021', 'request_id': 'req-f122ecf1-a74c-4877-a290-568544d6d2f2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.150251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:14.161851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:14.181316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] The token cache is being invalidate because project 6d43e2910352432b9b410962c0b2b021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:51:14.181316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.185754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-f122ecf1-a74c-4877-a290-568544d6d2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.194219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1182/2362] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:51:13 2022] DELETE /identity/v3/projects/6d43e2910352432b9b410962c0b2b021 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:14.197020 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d6119-ecc6-40ff-be72-07bbe72ef039 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:14.202116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0639be-494b-4c2e-8ab1-99e109f57089 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.202777 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0639be-494b-4c2e-8ab1-99e109f57089 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.203260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0639be-494b-4c2e-8ab1-99e109f57089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:14.304735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ac0639be-494b-4c2e-8ab1-99e109f57089 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:14.309645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ac0639be-494b-4c2e-8ab1-99e109f57089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:14.338025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:14.339181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.339386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.339839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] PATH_INFO: `/v3/projects/37eed9f8fe9742bb8336efcd48231eb2` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:14.341166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37eed9f8fe9742bb8336efcd48231eb2)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:14.343528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:14.427274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1183/2363] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:14.434966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.435260 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.435546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:14.524158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:14.524158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:14.524158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1184/2364] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:51:14.526785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:14.537825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e162c-f4cc-43ca-acab-2cc73d4ed4e7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:14.542931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:14.543704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.543880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.544165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:14.544894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:51:14.545198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:14.547351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:14.563366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1185/2365] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:51:14.570485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:14.581575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6032-5d73-48d5-92a8-1ac80d428005 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:14.586386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:14.587119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.587588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.587877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:14.588596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:14.590758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:14.856637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1186/2366] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:51:14 2022] POST /identity/v3/projects => generated 371 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:51:14.861213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:14.869128 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37eed9f8fe9742bb8336efcd48231eb2', 'request_id': 'req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.941421 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37eed9f8fe9742bb8336efcd48231eb2', 'request_id': 'req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.941521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:14.944194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37eed9f8fe9742bb8336efcd48231eb2', 'request_id': 'req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.953657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01aa9e-4aed-440d-85f1-ee9b9e71e0ab admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:14.964557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] The token cache is being invalidate because project 37eed9f8fe9742bb8336efcd48231eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:51:14.964891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.965911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:14.966810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.966988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.967208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:14.967682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a6b1bdab-4302-4c3a-9ee6-4cd3d2ce4e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:14.970046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:14.972238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1181/2367] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:51:14 2022] DELETE /identity/v3/projects/37eed9f8fe9742bb8336efcd48231eb2 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:14.973004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:14.978645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a1c3-ceea-43fc-9e47-7cf347adedb4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:14.978980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a1c3-ceea-43fc-9e47-7cf347adedb4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:14.979272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a1c3-ceea-43fc-9e47-7cf347adedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.009572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5745a1c3-ceea-43fc-9e47-7cf347adedb4 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:15.011254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5745a1c3-ceea-43fc-9e47-7cf347adedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:15.030480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1182/2368] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:51:15.032132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.032434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.032725 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.078357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1187/2369] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:51:14 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:51:15.079506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.084583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:15.089401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:15.089401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:15.106291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1183/2370] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:15.109615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.109776 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21367e0-1a8b-4db8-a3a7-268ebb3fed6a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.115850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.116881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.117244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.117639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.118780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.120393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.121194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197658cf-fdbe-4cbe-a9cb-5396ca0b8998 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.130440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.131381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.132295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.132295 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.133422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:51:15.134031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.135854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.140047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1188/2371] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:51:15.141222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.157750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1184/2372] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:51:15.158647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d0fc-7bed-4855-b20a-8db30c5d472d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.161414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.166001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.166806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.167171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.167506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.168313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.170910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.176986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f81d4-5858-4a8e-bec0-96bbcac664ab admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.186054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.187076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.187558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.188031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.188987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.191744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.192576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1189/2373] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:51:15.193641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.207341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9502-fee2-403e-8569-c29e422e1bab admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.210496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:15.213618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820fcd6-3d78-4b86-8711-aed8b9a7d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.214606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820fcd6-3d78-4b86-8711-aed8b9a7d5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.214978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820fcd6-3d78-4b86-8711-aed8b9a7d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.215349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820fcd6-3d78-4b86-8711-aed8b9a7d5c0 admin admin] PATH_INFO: `/v3/projects/148becbb63f7436cb8f991b95cf7d7b8/users/433494aba02041278f00642064bba20c/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.242485 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820fcd6-3d78-4b86-8711-aed8b9a7d5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148becbb63f7436cb8f991b95cf7d7b8, user_id=433494aba02041278f00642064bba20c, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.247990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820fcd6-3d78-4b86-8711-aed8b9a7d5c0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.301511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1185/2374] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:51:15 2022] POST /identity/v3/projects => generated 359 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:51:15.302785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.331584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1190/2375] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:51:15 2022] PUT /identity/v3/projects/148becbb63f7436cb8f991b95cf7d7b8/users/433494aba02041278f00642064bba20c/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:15.342635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.343082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.343082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.410399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] MFA Rules not processed for user `433494aba02041278f00642064bba20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:15.411953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:15.438427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705121ca-6b3d-4073-a5f5-f24ffcf88484 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.513608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1191/2376] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:51:15.527117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.527632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.532246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.532246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.532246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.532523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.532523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:15.532670 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.627170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1186/2377] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:51:15 2022] POST /identity/v3/users => generated 280 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:51:15.634329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.636603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3e18-8566-4d23-8f41-923ae027c2e9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.641700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.642371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.642663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.643037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.651617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dec22-999a-427f-a7ca-675cafd5b84e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.656842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.658724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.659933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.660857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.661492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.662019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.663087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.686793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.708194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1192/2378] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:15.714276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1187/2379] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:51:15.719989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.769123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dc119-4a1c-4f52-b64e-e07ec3385263 service glance] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.791210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99715b-b45e-4ab8-9251-80390f77fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.791908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99715b-b45e-4ab8-9251-80390f77fa59 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.792207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99715b-b45e-4ab8-9251-80390f77fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.792467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99715b-b45e-4ab8-9251-80390f77fa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.793206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99715b-b45e-4ab8-9251-80390f77fa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.809987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99715b-b45e-4ab8-9251-80390f77fa59 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:15.861331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1193/2380] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:51:15.865630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:15.886182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aec46-eb7f-4674-a67a-1dd3fd3267db admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:15.894827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:15.896314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:15.896709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:15.897104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] PATH_INFO: `/v3/projects/d3b0da71f9d8457bbce7126918a34782/users/7ca5b76c1eb84c1e80708b4c1b356b1a/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:15.955124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b0da71f9d8457bbce7126918a34782, user_id=7ca5b76c1eb84c1e80708b4c1b356b1a, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:15.959814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:16.052536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1188/2381] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:51:15 2022] PUT /identity/v3/projects/d3b0da71f9d8457bbce7126918a34782/users/7ca5b76c1eb84c1e80708b4c1b356b1a/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:16.066088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:16.066317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:16.067384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:16.126445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] MFA Rules not processed for user `7ca5b76c1eb84c1e80708b4c1b356b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:16.133826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:16.300353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1194/2382] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:16.369214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:16.371644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:16.460355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:16.569948 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1904-3c9e-4b3b-80ac-ea823cdc9629 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:16.579193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61800af7-98b1-4997-84af-b6e8e67574be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:16.579193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61800af7-98b1-4997-84af-b6e8e67574be service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:16.579193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61800af7-98b1-4997-84af-b6e8e67574be service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:16.579193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61800af7-98b1-4997-84af-b6e8e67574be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:16.597161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61800af7-98b1-4997-84af-b6e8e67574be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:16.599338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61800af7-98b1-4997-84af-b6e8e67574be service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:16.610508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1189/2383] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:16 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:16.629474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:16.712007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:16.786625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30705e78-20e3-4d75-b65f-8bda637cfecc None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:16.792831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:16.793928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:16.794217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:16.794496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] PATH_INFO: `/v3/users/7ca5b76c1eb84c1e80708b4c1b356b1a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:16.797216 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca5b76c1eb84c1e80708b4c1b356b1a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:16.801608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:17.168624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca5b76c1eb84c1e80708b4c1b356b1a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:17.184450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca5b76c1eb84c1e80708b4c1b356b1a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:17.186114 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca5b76c1eb84c1e80708b4c1b356b1a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:17.186935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca5b76c1eb84c1e80708b4c1b356b1a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:17.213223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca5b76c1eb84c1e80708b4c1b356b1a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:17.313610 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1195/2384] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:51:16 2022] DELETE /identity/v3/users/7ca5b76c1eb84c1e80708b4c1b356b1a => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:17.316586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:17.317191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:17.317817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:17.339751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:17.341239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:17.481349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1190/2385] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:51:17.529037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:17.531008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:17.627903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:17.668441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8267f-4340-48df-ba5b-40e25c06da35 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:17.672721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108e5dd-2d9c-478a-9996-bd19ae7202d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:17.673433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108e5dd-2d9c-478a-9996-bd19ae7202d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:17.673722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108e5dd-2d9c-478a-9996-bd19ae7202d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:17.674009 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108e5dd-2d9c-478a-9996-bd19ae7202d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:17.689534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108e5dd-2d9c-478a-9996-bd19ae7202d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:17.691720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108e5dd-2d9c-478a-9996-bd19ae7202d7 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:17.714204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1196/2386] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:18.275384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:18.278100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:18.311720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a8b6c-edd2-4a21-a93e-4bb669ddbd39 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:18.329025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:18.337764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:18.337764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:18.337764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] PATH_INFO: `/v3/projects/d3b0da71f9d8457bbce7126918a34782` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:18.337764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b0da71f9d8457bbce7126918a34782)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:18.338130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:18.561727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b0da71f9d8457bbce7126918a34782', 'request_id': 'req-b26bcf41-e86d-4d70-90ac-cd8e53980324'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:19.883972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b0da71f9d8457bbce7126918a34782', 'request_id': 'req-b26bcf41-e86d-4d70-90ac-cd8e53980324'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:19.897000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b0da71f9d8457bbce7126918a34782', 'request_id': 'req-b26bcf41-e86d-4d70-90ac-cd8e53980324'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:19.925289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] The token cache is being invalidate because project d3b0da71f9d8457bbce7126918a34782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:51:19.925427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:19.927276 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b26bcf41-e86d-4d70-90ac-cd8e53980324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:19.933316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1191/2387] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:51:18 2022] DELETE /identity/v3/projects/d3b0da71f9d8457bbce7126918a34782 => generated 0 bytes in 1655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:19.936163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:19.937467 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:19.945094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:19.966633 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:19.968240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:20.101510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1197/2388] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:20.104152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.110345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.118038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.168284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:20.170805 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:20.192587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1192/2389] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:20.193580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:20.209071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaaa0e-f793-46b8-9ddd-0a23e6375fc2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:20.223375 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:20.225685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.225685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.225685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.225685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:51:20.225685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:20.227458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:20.263739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1198/2390] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:51:20.278217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:20.301761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce05db-0b1c-4213-b4fc-3724a97ef052 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:20.320252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:20.321238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.321701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.322185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.323077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:20.325173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:20.439937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1193/2391] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:51:20 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:51:20.440220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:20.452928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7535-bf10-4300-8122-f086c245eb1a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:20.541587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:20.542416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.542810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.543200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.543988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:20.547085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:20.644471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1199/2392] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:51:20 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:51:20.648468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:20.658982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be477b63-397b-4fd3-ab15-6d7c331b1b4c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:20.666785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:20.667603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.667989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.668365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.669182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:20.671003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:20.684827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1194/2393] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:51:20.688696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:20.700050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938632a-59f6-445f-be2d-c6bd2006d945 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:20.705356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b32c1-686a-42a7-b7fb-4fc4e71426f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:20.708230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b32c1-686a-42a7-b7fb-4fc4e71426f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.708661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b32c1-686a-42a7-b7fb-4fc4e71426f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.709042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b32c1-686a-42a7-b7fb-4fc4e71426f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.709934 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b32c1-686a-42a7-b7fb-4fc4e71426f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:20.711713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b32c1-686a-42a7-b7fb-4fc4e71426f5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:20.724627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1200/2394] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:51:20.729315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:20.740935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494e61d-b81c-44dc-9cb9-f63b1e255910 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:20.746458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:20.747385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:20.747675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:20.747959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] PATH_INFO: `/v3/projects/7ab25929bbd643a68f0f01f1fb22b292/users/1da333ac86414ffd9661dbd15594e736/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:20.766890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab25929bbd643a68f0f01f1fb22b292, user_id=1da333ac86414ffd9661dbd15594e736, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:20.769064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:21.027122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:21.033490 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1195/2395] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:51:20 2022] PUT /identity/v3/projects/7ab25929bbd643a68f0f01f1fb22b292/users/1da333ac86414ffd9661dbd15594e736/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:21.039950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458e900-3f81-4374-8b86-00091bd95717 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:21.040420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458e900-3f81-4374-8b86-00091bd95717 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:21.040670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458e900-3f81-4374-8b86-00091bd95717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:21.064855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9458e900-3f81-4374-8b86-00091bd95717 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:21.064855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9458e900-3f81-4374-8b86-00091bd95717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:21.108828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:21.143247 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1201/2396] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:21.153880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:21.160273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:21.284515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd48d10-7f00-4498-a300-f9b27c57f276 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:21.289906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:21.290582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:21.290874 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:21.291156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:21.319127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:21.321387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:21.352593 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1196/2397] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:29.035793 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.037028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.037028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.067349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] MFA Rules not processed for user `1da333ac86414ffd9661dbd15594e736`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:29.068893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:29.139708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1202/2398] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:29.144417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:29.155519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53839653-2ad1-4159-b0e0-dde258406982 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:29.161646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:29.162327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.162615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.162929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.163607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:29.165558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:29.261372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1197/2399] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:51:29 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:51:29.265174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:29.277586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575fcb-7d7a-4c8b-ac97-bd1d71f44070 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:29.346877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:29.347666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.348500 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.348971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.349921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:29.351914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:29.456262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1203/2400] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:51:29 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:51:29.462065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:29.472573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15b31-cd8e-4f0c-b4e7-c5ec2cc20b46 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:29.478385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:29.480694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.480694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.480694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.480694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:29.482126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:29.500344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1198/2401] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:51:29.501657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:29.513264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7ace3-32ff-4286-bf44-503d02d9faa7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:29.518354 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:29.519412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.520368 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.520806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] PATH_INFO: `/v3/projects/8e574e097b4d41c0a28fd202b6417017/users/33a4b747bce449e98cde5c99c16a63eb/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.537210 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e574e097b4d41c0a28fd202b6417017, user_id=33a4b747bce449e98cde5c99c16a63eb, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:29.539937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:29.628616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1204/2402] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:51:29 2022] PUT /identity/v3/projects/8e574e097b4d41c0a28fd202b6417017/users/33a4b747bce449e98cde5c99c16a63eb/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:29.633179 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:29.644077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4548-6905-4379-aa2f-9ca4f5346cf3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:29.706877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:29.708284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.708573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.708852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.709620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:29.711247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:29.724151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1199/2403] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:51:29.727597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:29.739596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2c33-2a74-4d70-bfe0-517242dd43c3 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:29.744810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88964051-fcea-45be-960b-32b662cbe465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:29.745890 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88964051-fcea-45be-960b-32b662cbe465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:29.746184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88964051-fcea-45be-960b-32b662cbe465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:29.746477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88964051-fcea-45be-960b-32b662cbe465 admin admin] PATH_INFO: `/v3/projects/8e574e097b4d41c0a28fd202b6417017/users/33a4b747bce449e98cde5c99c16a63eb/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:29.748854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88964051-fcea-45be-960b-32b662cbe465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e574e097b4d41c0a28fd202b6417017, user_id=33a4b747bce449e98cde5c99c16a63eb, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:29.751841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88964051-fcea-45be-960b-32b662cbe465 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:29.766259 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1205/2404] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:51:29 2022] PUT /identity/v3/projects/8e574e097b4d41c0a28fd202b6417017/users/33a4b747bce449e98cde5c99c16a63eb/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:31.971412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:31.973304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:32.137358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:32.190729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc1a14-210b-4f8e-a37c-262a653a2f1f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:32.313136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:32.314307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:32.314877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:32.315974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:32.318861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:32.334247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:32.336261 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd18b-bfbb-4085-9cdf-bf48c61ea296 service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:32.348877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1200/2405] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:51:32.504947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28c15e-535e-4040-8ffb-51fe0083f6a2 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:32.506023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28c15e-535e-4040-8ffb-51fe0083f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:32.506494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28c15e-535e-4040-8ffb-51fe0083f6a2 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:32.508494 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1206/2406] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:51:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:51:32.516838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd083-6527-49f5-a52b-7e63913c19f3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:32.517151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd083-6527-49f5-a52b-7e63913c19f3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:32.517461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd083-6527-49f5-a52b-7e63913c19f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:32.659887 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-02bdd083-6527-49f5-a52b-7e63913c19f3 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:32.663976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-02bdd083-6527-49f5-a52b-7e63913c19f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:32.805712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1201/2407] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:32.820843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28c15e-535e-4040-8ffb-51fe0083f6a2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:32.823745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1f28c15e-535e-4040-8ffb-51fe0083f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:32.880039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:32.960774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28c15e-535e-4040-8ffb-51fe0083f6a2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:32.964932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dd969-5839-4c15-b9b9-9cb324cb1b3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:32.965736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dd969-5839-4c15-b9b9-9cb324cb1b3b service glance] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:32.966020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dd969-5839-4c15-b9b9-9cb324cb1b3b service glance] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:32.966303 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dd969-5839-4c15-b9b9-9cb324cb1b3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:32.982888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dd969-5839-4c15-b9b9-9cb324cb1b3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:32.984796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dd969-5839-4c15-b9b9-9cb324cb1b3b service glance] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:33.016228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1207/2408] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:33.262069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff9ec-10b2-4721-a6ff-d5415b9cb050 None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:33.262968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff9ec-10b2-4721-a6ff-d5415b9cb050 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:33.263603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ff9ec-10b2-4721-a6ff-d5415b9cb050 None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:33.265701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1202/2409] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:51:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:51:33.272780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491ef67-7ac2-4f9f-81af-faca277ff8e8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:33.273374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491ef67-7ac2-4f9f-81af-faca277ff8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:33.274472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491ef67-7ac2-4f9f-81af-faca277ff8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:33.294592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f491ef67-7ac2-4f9f-81af-faca277ff8e8 None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:33.295830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f491ef67-7ac2-4f9f-81af-faca277ff8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:33.358715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1208/2410] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:33.371105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ff9ec-10b2-4721-a6ff-d5415b9cb050 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:33.372806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f70ff9ec-10b2-4721-a6ff-d5415b9cb050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:33.387785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ff9ec-10b2-4721-a6ff-d5415b9cb050 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:33.393446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09ff0f-f18c-4957-a8f9-f5f7020b8802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:33.397529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09ff0f-f18c-4957-a8f9-f5f7020b8802 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:33.397529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09ff0f-f18c-4957-a8f9-f5f7020b8802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:33.397529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09ff0f-f18c-4957-a8f9-f5f7020b8802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:33.405487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09ff0f-f18c-4957-a8f9-f5f7020b8802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:33.406959 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09ff0f-f18c-4957-a8f9-f5f7020b8802 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:33.416521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1203/2411] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:51:33.581201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe286b-ce06-4d68-a413-33b6fbe0ea3b None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:33.581753 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe286b-ce06-4d68-a413-33b6fbe0ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:33.581948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe286b-ce06-4d68-a413-33b6fbe0ea3b None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:33.586173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1209/2412] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:51:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:51:33.592797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b1f1-0ca4-492f-a098-fcfeb84c122f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:33.593093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b1f1-0ca4-492f-a098-fcfeb84c122f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:33.593408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b1f1-0ca4-492f-a098-fcfeb84c122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:33.633123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-4cf8b1f1-0ca4-492f-a098-fcfeb84c122f None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:33.635520 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4cf8b1f1-0ca4-492f-a098-fcfeb84c122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:33.655528 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1204/2413] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:33.672080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe286b-ce06-4d68-a413-33b6fbe0ea3b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:33.688950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe286b-ce06-4d68-a413-33b6fbe0ea3b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:33.694794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8343f-c0e7-4df7-911b-d1e440824447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:33.695805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8343f-c0e7-4df7-911b-d1e440824447 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:33.696155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8343f-c0e7-4df7-911b-d1e440824447 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:33.696650 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8343f-c0e7-4df7-911b-d1e440824447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:33.711517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8343f-c0e7-4df7-911b-d1e440824447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:33.713248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8343f-c0e7-4df7-911b-d1e440824447 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:33.729862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1210/2414] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:36.798649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:36.799180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:36.799336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:36.834340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:36.881789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:36.883447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:36.942532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:36.943082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:36.943173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:36.982000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] MFA Rules not processed for user `33a4b747bce449e98cde5c99c16a63eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:36.983451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:36.985170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1205/2415] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:36.999463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:37.001946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:37.115093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1211/2416] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:37.130426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:37.133322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:37.156735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d8b6-a4dd-4c07-b378-5f221a7859f3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:37.165765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:37.166806 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:37.167187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:37.167626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:37.180441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fba794-abae-4bea-b7be-0fa81eb35b71 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:37.192643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e5f3-dc1b-4e7a-a1f5-e7e9fb70b3bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:37.192643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e5f3-dc1b-4e7a-a1f5-e7e9fb70b3bc service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:37.192643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e5f3-dc1b-4e7a-a1f5-e7e9fb70b3bc service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:37.192643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e5f3-dc1b-4e7a-a1f5-e7e9fb70b3bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:37.202728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6e5f3-dc1b-4e7a-a1f5-e7e9fb70b3bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:37.203222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:37.205077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6e5f3-dc1b-4e7a-a1f5-e7e9fb70b3bc service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:37.220775 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1206/2417] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:51:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:51:37.247081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:37.249563 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:37.264262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1212/2418] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:40.000126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7925e-518f-4905-81b6-9b3253db1dba None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:40.001309 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7925e-518f-4905-81b6-9b3253db1dba None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:40.001767 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7925e-518f-4905-81b6-9b3253db1dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:40.034110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6ac7925e-518f-4905-81b6-9b3253db1dba None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:40.036204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6ac7925e-518f-4905-81b6-9b3253db1dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:40.061972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1207/2419] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:40.155676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:40.203238 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbab78-9ec8-4586-9594-9e73fa756952 service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:40.233871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:40.233871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:40.233871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:40.233871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:40.324350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:40.328894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:40.362790 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1213/2420] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:51:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:51:41.676318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717cbf-7719-4cc4-ae0c-ab6375ce8f2f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:41.677701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717cbf-7719-4cc4-ae0c-ab6375ce8f2f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:41.677840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717cbf-7719-4cc4-ae0c-ab6375ce8f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:41.817123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-35717cbf-7719-4cc4-ae0c-ab6375ce8f2f None None] MFA Rules not processed for user `1da333ac86414ffd9661dbd15594e736`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:41.829627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-35717cbf-7719-4cc4-ae0c-ab6375ce8f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:41.829865 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1208/2421] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:50.354985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=23 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:51.733938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=80 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:52.879170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:52.881213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:52.974066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45191-bc1c-4f0b-89f8-09f8f2c3eb31 service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:52.979648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:52.980486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:52.980773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:52.981081 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] PATH_INFO: `/v3/users/433494aba02041278f00642064bba20c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:52.982383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=433494aba02041278f00642064bba20c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:52.984322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:53.218649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433494aba02041278f00642064bba20c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:53.241230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433494aba02041278f00642064bba20c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:53.242359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433494aba02041278f00642064bba20c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:53.243135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433494aba02041278f00642064bba20c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:53.268061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433494aba02041278f00642064bba20c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:53.358655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1214/2422] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:51:52 2022] DELETE /identity/v3/users/433494aba02041278f00642064bba20c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:53.367794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:53.369017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:53.369372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:53.399362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:53.406622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:53.503331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1209/2423] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:53.516057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:53.518888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:53.616827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c06ce-8d55-430d-9b8b-deee9932c24b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:53.622265 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a72fc5-0d37-435e-889d-f402cfe8d4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:53.623815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a72fc5-0d37-435e-889d-f402cfe8d4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:53.624379 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a72fc5-0d37-435e-889d-f402cfe8d4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:53.625030 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a72fc5-0d37-435e-889d-f402cfe8d4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:53.639735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a72fc5-0d37-435e-889d-f402cfe8d4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:53.644734 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a72fc5-0d37-435e-889d-f402cfe8d4a9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:53.671646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1215/2424] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:51:54.307088 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:54.309180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:54.338747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ea2e-6f27-4cf7-b489-08623994f3e8 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:54.344907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:54.346003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:54.346230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:54.346606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] PATH_INFO: `/v3/projects/148becbb63f7436cb8f991b95cf7d7b8` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:54.347720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148becbb63f7436cb8f991b95cf7d7b8)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:54.350724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:54.484680 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148becbb63f7436cb8f991b95cf7d7b8', 'request_id': 'req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:54.555266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148becbb63f7436cb8f991b95cf7d7b8', 'request_id': 'req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:54.563606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148becbb63f7436cb8f991b95cf7d7b8', 'request_id': 'req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:54.581672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] The token cache is being invalidate because project 148becbb63f7436cb8f991b95cf7d7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:51:54.585644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:54.590967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:51:54.605847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1210/2425] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:51:54 2022] DELETE /identity/v3/projects/148becbb63f7436cb8f991b95cf7d7b8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:51:58.509673 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:58.510256 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:58.510844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:58.532080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:51:58.533447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:58.578609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:58.620528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1216/2426] 10.222.0.70 () {58 vars in 967 bytes} [Tue Jun 21 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:51:58.634259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:51:58.635928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:51:58.719730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef683ff1-17d5-4b82-9c1b-202235f0dcf4 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:51:58.724899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:51:58.725885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:51:58.726178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:51:58.726454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:51:58.734894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:51:58.736467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:51:58.745462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1211/2427] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:51:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:52:01.949836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:01.949836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:02.020555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a531-9c47-41ee-b87e-f21afd509291 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:02.025996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:02.026863 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:02.027164 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:02.027443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] PATH_INFO: `/v3/users/127c04cf84664a7582853dec90f130b6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:02.028697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=127c04cf84664a7582853dec90f130b6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:02.030707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:02.421591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127c04cf84664a7582853dec90f130b6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:02.429929 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127c04cf84664a7582853dec90f130b6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:02.430653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127c04cf84664a7582853dec90f130b6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:02.431253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127c04cf84664a7582853dec90f130b6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:02.443149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-43a73ecb-8bae-4416-a677-71165b52e5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127c04cf84664a7582853dec90f130b6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:02.654205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1217/2428] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:52:01 2022] DELETE /identity/v3/users/127c04cf84664a7582853dec90f130b6 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:52:02.871687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:02.884254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f8d8-6a0f-446e-b19d-1d0b66406f15 service swift] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:02.906157 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:02.958844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:02.962417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:02.962417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:02.962417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] PATH_INFO: `/v3/projects/83fb026ffcbd4a71929a4b3c860b3bee` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:02.962988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fb026ffcbd4a71929a4b3c860b3bee)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:02.964911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.100555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fb026ffcbd4a71929a4b3c860b3bee', 'request_id': 'req-a01f3a43-c0d6-480e-aefb-9831dcd67a39'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:03.273325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fb026ffcbd4a71929a4b3c860b3bee', 'request_id': 'req-a01f3a43-c0d6-480e-aefb-9831dcd67a39'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:03.280221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fb026ffcbd4a71929a4b3c860b3bee', 'request_id': 'req-a01f3a43-c0d6-480e-aefb-9831dcd67a39'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:03.293264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] The token cache is being invalidate because project 83fb026ffcbd4a71929a4b3c860b3bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:52:03.293652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:03.294245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a01f3a43-c0d6-480e-aefb-9831dcd67a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:52:03.296108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1212/2429] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:52:02 2022] DELETE /identity/v3/projects/83fb026ffcbd4a71929a4b3c860b3bee => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:52:03.307810 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.308395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.308395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.329036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:03.330330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:03.385949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:03.405150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1218/2430] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:03.413695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.413982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.414263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.434966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:03.436181 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:03.444239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1213/2431] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:03.448450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:03.463759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fe581-6e67-4af3-a265-b08c16f61dc5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:03.468985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:03.469700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.471011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.471011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.471011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:52:03.471359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:03.472858 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.486293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1219/2432] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:52:03.491130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:03.501587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466183a-eee0-4211-b0ef-8380bbe13352 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:03.506399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:03.507105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.507393 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.507879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.508591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:03.510611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.574685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1214/2433] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:52:03 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:52:03.578888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:03.590050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d0fd7-0fd1-4dad-afd2-8d3fdd9aabf1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:03.662903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:03.662903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.662903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.662903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.664366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:03.664366 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.750602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1220/2434] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:52:03 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:52:03.754884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:03.766586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe860081-b0e7-41f4-a367-750ba701c000 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:03.771511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:03.772184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.776729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.776729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.776729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:03.776729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.786384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1215/2435] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:52:03.791451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:03.804403 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4349c1-876a-4afd-b574-77cf04639317 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:03.810451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388369-9b82-44eb-93ae-a01a922e8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:03.811327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388369-9b82-44eb-93ae-a01a922e8c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.811663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388369-9b82-44eb-93ae-a01a922e8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.811956 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388369-9b82-44eb-93ae-a01a922e8c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.812698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5388369-9b82-44eb-93ae-a01a922e8c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:03.815976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5388369-9b82-44eb-93ae-a01a922e8c98 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.830085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1221/2436] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:52:03.831291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:03.842009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b852f-3d8b-43e4-bf42-4c51ba386f1b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:03.847120 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:03.848054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.848374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.848649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] PATH_INFO: `/v3/projects/7a8a0ae0c16a41c8b34547406830813a/users/0ebe6382afe24ef489261081e8610271/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.865052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8a0ae0c16a41c8b34547406830813a, user_id=0ebe6382afe24ef489261081e8610271, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:03.868055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:03.945479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1216/2437] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:52:03 2022] PUT /identity/v3/projects/7a8a0ae0c16a41c8b34547406830813a/users/0ebe6382afe24ef489261081e8610271/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:52:03.950958 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd4ddf-a885-437c-ad2e-9e3cee31d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:03.957675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd4ddf-a885-437c-ad2e-9e3cee31d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:03.957675 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd4ddf-a885-437c-ad2e-9e3cee31d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:03.986935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4fdd4ddf-a885-437c-ad2e-9e3cee31d6a1 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:03.988147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4fdd4ddf-a885-437c-ad2e-9e3cee31d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:04.054436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1222/2438] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:04.064343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:04.066190 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:04.112109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:04.127355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06848ed1-61c2-4510-9001-524bd7c016de admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:04.131133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:04.131784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:04.132712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:04.132983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:04.142843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:04.144347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:04.154651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1217/2439] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:52:05.371456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9140c-7335-4c3b-b4a6-faf2f1b01730 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:05.371942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9140c-7335-4c3b-b4a6-faf2f1b01730 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:05.372149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9140c-7335-4c3b-b4a6-faf2f1b01730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:05.394430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-50e9140c-7335-4c3b-b4a6-faf2f1b01730 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:05.394430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-50e9140c-7335-4c3b-b4a6-faf2f1b01730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:05.454792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:05.464049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1223/2440] 10.222.0.70 () {58 vars in 967 bytes} [Tue Jun 21 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:05.486628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:05.488136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:05.592248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e402-20d9-4bed-8ccb-20002bfc0655 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:05.608979 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:05.609686 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:05.609976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:05.610257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:05.620097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:05.622272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:05.630633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1218/2441] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:52:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:52:09.978641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:09.978641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:09.978641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.020455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] MFA Rules not processed for user `0ebe6382afe24ef489261081e8610271`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:10.021720 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:10.125713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1224/2442] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:10.127238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:10.139702 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b6ca4-42ac-463b-ae55-0d8fff11aec9 service swift] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:10.144692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:10.145594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:10.145876 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:10.146226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.147014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:10.149063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:10.238303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1219/2443] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:52:10 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:52:10.244327 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:10.259295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13efcab-977e-45f9-89ff-704e3067962a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:10.338574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:10.338574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:10.338574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:10.338574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.339808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:10.346471 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:10.432121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1225/2444] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:52:10 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:52:10.438127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:10.450869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808236-2ad6-4078-a67c-f90040c07328 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:10.455665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:10.456335 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:10.456626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:10.456925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.457688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:10.459286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:10.471188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1220/2445] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:52:10.475475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:10.486709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb5c8-c16c-408a-81fc-767c8c7cd2c1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:10.492414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:10.493706 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:10.493986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:10.494341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] PATH_INFO: `/v3/projects/227bca94df554c06a22b74319d819d8c/users/177a51423b98406b88ab0133738a8788/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.512597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227bca94df554c06a22b74319d819d8c, user_id=177a51423b98406b88ab0133738a8788, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:10.520027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:10.588278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1226/2446] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:52:10 2022] PUT /identity/v3/projects/227bca94df554c06a22b74319d819d8c/users/177a51423b98406b88ab0133738a8788/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:52:10.592554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:10.605394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f497d1-78f0-4d92-b624-3e74272a46dc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:10.677962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d3e7-9a11-4cb0-8326-200f7f42709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:10.678361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d3e7-9a11-4cb0-8326-200f7f42709b admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:10.678903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d3e7-9a11-4cb0-8326-200f7f42709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:10.679974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d3e7-9a11-4cb0-8326-200f7f42709b admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.680585 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35d3e7-9a11-4cb0-8326-200f7f42709b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:10.682299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35d3e7-9a11-4cb0-8326-200f7f42709b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:10.693561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1221/2447] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:52:10.697769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:10.716213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e3a96-52c4-4374-be26-70da0063bf98 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:10.721441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:10.722344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:10.722628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:10.722905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] PATH_INFO: `/v3/projects/227bca94df554c06a22b74319d819d8c/users/177a51423b98406b88ab0133738a8788/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:10.724893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227bca94df554c06a22b74319d819d8c, user_id=177a51423b98406b88ab0133738a8788, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:10.729084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:10.739447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1227/2448] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:52:10 2022] PUT /identity/v3/projects/227bca94df554c06a22b74319d819d8c/users/177a51423b98406b88ab0133738a8788/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:52:17.148121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019d33-da03-4997-8971-74328b5fb584 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:17.150918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019d33-da03-4997-8971-74328b5fb584 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:17.150918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019d33-da03-4997-8971-74328b5fb584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:17.179084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-43019d33-da03-4997-8971-74328b5fb584 None None] MFA Rules not processed for user `177a51423b98406b88ab0133738a8788`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:17.180942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-43019d33-da03-4997-8971-74328b5fb584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:17.209832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:17.278129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1222/2449] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:17.286099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:17.288324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:17.339686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:17.375915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef7aa-b27b-4542-a1bf-1bef20155110 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:17.381952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66d6c4-b232-4a37-b512-b82afd3fc4da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:17.383288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66d6c4-b232-4a37-b512-b82afd3fc4da service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:17.383580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66d6c4-b232-4a37-b512-b82afd3fc4da service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:17.383906 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66d6c4-b232-4a37-b512-b82afd3fc4da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:17.446401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66d6c4-b232-4a37-b512-b82afd3fc4da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:17.448162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66d6c4-b232-4a37-b512-b82afd3fc4da service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:17.457691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1228/2450] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:52:27.339833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=18 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:27.453465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=38 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:36.680816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019d33-da03-4997-8971-74328b5fb584 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:52:36.734718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019d33-da03-4997-8971-74328b5fb584 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:52:36.738980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:52:36.739625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:36.739916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:36.740202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:36.742085 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:36.807591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:52:36.809051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f48989-02d4-4906-9155-1fa04dc84604 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:52:36.819385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1223/2451] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:52:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:52:40.592546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:40.593037 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:40.593154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:40.610319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] MFA Rules not processed for user `0ebe6382afe24ef489261081e8610271`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:40.611511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:40.619724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1229/2452] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:52:46.814939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=50 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:50.605482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:51.767511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc333-75e0-4073-aec7-e3020d1d5b47 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:52:51.768010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc333-75e0-4073-aec7-e3020d1d5b47 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:52:51.768127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc333-75e0-4073-aec7-e3020d1d5b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:52:51.787833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-309fc333-75e0-4073-aec7-e3020d1d5b47 None None] MFA Rules not processed for user `f45384380b364e60823101515b359ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:52:51.789104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-309fc333-75e0-4073-aec7-e3020d1d5b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:52:51.844538 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1224/2453] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:53:00.886457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:00.887938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:00.899966 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b6202-0a66-409b-863b-b5b41ed52d84 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:00.903501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:00.904144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:00.904432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:00.904712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:00.914020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:00.915458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:00.925387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1230/2454] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:53:01.837574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=25 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:10.920743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:11.674657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:11.675202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:11.675202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:11.693457 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] MFA Rules not processed for user `a25a52e592a34cd48a8c88304501c047`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:53:11.694674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:11.755007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1225/2455] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:53:21.742328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=25 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:41.676100 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:41.677536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:41.734860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0ad4-5712-4306-b99f-3d4e1befed9a service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:41.738437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:41.739078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:41.739390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:41.739671 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:41.741488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:41.800025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:41.801533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:41.811220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1231/2456] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:53:42.341784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:42.353048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d78de5-d007-4f92-86fe-89d75413e1ca None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:42.356650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:42.357319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:42.357613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:42.357907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:42.359704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:42.374165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:42.375583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66bd8f-00f2-4970-a54f-8223675ee5a3 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:42.386700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1226/2457] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:53:43.564011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:43.574136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b3d4e-733c-4448-992e-5d120a115c01 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:43.577688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:43.578322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:43.578606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:43.578887 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:43.580719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:43.594310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:43.595740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:43.607278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1232/2458] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:53:50.376465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:50.376975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:50.377073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:50.394975 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] MFA Rules not processed for user `52ad18360dc64d2ea85cc950c9daa723`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:53:50.396194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:50.403909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1227/2459] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:53:50.710239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:50.719283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0d38-fda0-4e54-8115-0442f847545d service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:50.723020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:50.723655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:50.723945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:50.724231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:50.726093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:50.736342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:50.737829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:50.745842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1233/2460] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:53:51.229271 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:51.230729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:51.318756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180390e6-699b-4fa8-a6ed-846238e1a2b2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:51.324507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:51.325155 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:51.325469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:51.325749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:51.327499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:51.339055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:51.340616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:51.350801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1228/2461] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:53:59.953816 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:53:59.962455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524974a5-49d3-438b-8b8f-ce38b5c003a9 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:53:59.966754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:53:59.967399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:53:59.967696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:53:59.967980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:53:59.969765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:53:59.979948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:53:59.981405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:53:59.989990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1234/2462] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:53:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:01.306559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:01.316448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d58a2-bf1d-4ad8-bf2f-a16af038fd61 service placement] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:01.319974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:01.320603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:01.320885 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:01.321165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:01.323922 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:01.334631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:01.336043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:01.346515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1229/2463] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:09.251125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:09.274730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f54d77-8611-4cbe-91b6-111560479c89 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:09.282053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:09.282763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:09.283049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:09.283331 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:09.285132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:09.302751 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:09.304377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:09.317107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1235/2464] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:10.781613 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:10.794257 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec042-ecf9-42d7-a28e-4491a2ff48a4 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:10.799696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:10.800365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:10.800656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:10.800943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:10.802736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:10.813891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:10.815462 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:10.825112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1230/2465] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:19.311736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=72 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:20.820323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=53 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:25.925239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:25.934482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309887d-3469-41a0-bb32-bcf2643c08ff service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:25.939218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:25.939852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:25.940135 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:25.940412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:25.942207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:26.007012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:26.008447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:26.018766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1236/2466] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:29.814938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:29.820499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:29.833675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ab00-ece7-4733-a29c-2cfed7236d25 service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:29.839284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:29.839946 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:29.840235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:29.840517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:29.843130 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:29.855742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:29.857352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:29.868713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1231/2467] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:29.959520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:29.961716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:29.977551 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf721a4f-ccab-48c6-a2cc-667b8632ec2c service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:29.982078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:29.983988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:29.984268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:29.984549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] PATH_INFO: `/v3/users/f45384380b364e60823101515b359ba6` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:29.985787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45384380b364e60823101515b359ba6)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:29.987923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:30.246320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45384380b364e60823101515b359ba6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.253690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45384380b364e60823101515b359ba6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.254377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45384380b364e60823101515b359ba6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.255001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45384380b364e60823101515b359ba6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.271859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fa79996d-33ca-4b2c-8782-c762cfc0f92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45384380b364e60823101515b359ba6'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.412693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1237/2468] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:54:29 2022] DELETE /identity/v3/users/f45384380b364e60823101515b359ba6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:54:30.653091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:30.666152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aa721-8244-4edd-ba6f-ef345c0b0f62 service placement] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:30.733510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:30.734629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:30.735011 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:30.735407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] PATH_INFO: `/v3/projects/25beca9acf4f4420b1a2dc0ec397847e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:30.736794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25beca9acf4f4420b1a2dc0ec397847e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:30.738912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:30.837159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25beca9acf4f4420b1a2dc0ec397847e', 'request_id': 'req-8b629c72-cf27-472f-b6ef-44288bc39af1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.917044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25beca9acf4f4420b1a2dc0ec397847e', 'request_id': 'req-8b629c72-cf27-472f-b6ef-44288bc39af1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.924317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25beca9acf4f4420b1a2dc0ec397847e', 'request_id': 'req-8b629c72-cf27-472f-b6ef-44288bc39af1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.935375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] The token cache is being invalidate because project 25beca9acf4f4420b1a2dc0ec397847e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:54:30.935732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.936362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-8b629c72-cf27-472f-b6ef-44288bc39af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:54:30.937958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1232/2469] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:54:30 2022] DELETE /identity/v3/projects/25beca9acf4f4420b1a2dc0ec397847e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:54:30.943055 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:30.943384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:30.943676 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:30.962530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:30.963752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:31.024731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1238/2470] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:31.033234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.033630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.033952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.052701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:31.053917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:31.062049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1233/2471] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:31.066634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.076383 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971304d1-33e8-4a5e-8d3d-0c8d37a30863 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.083254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.083254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.083254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.083254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.083695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:54:31.083695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.085067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.086634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:31.100415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1239/2472] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:54:31.102210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.112056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa205-26e0-4631-94da-6777e0ebaf7f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.116765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.117451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.117745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.123564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.123564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.123564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.201908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1234/2473] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:54:31 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:54:31.206632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.217512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503fb9-f347-4b47-ba0e-f8dc5a1311dd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.275051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.275731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.276019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.276302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.277007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.279021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.355082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1240/2474] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:54:31 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:54:31.360053 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.370447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd46f4-0d57-4d85-9c6a-cdb87122fd19 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.376250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.381574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.381574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.381574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.381574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.381574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.391220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1235/2475] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:54:31.395231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.405617 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e2ed4-88c9-481a-ac06-ba0664526ac1 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.410495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59385-fe0c-444e-a498-691b108bbf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.411151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59385-fe0c-444e-a498-691b108bbf58 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.411441 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59385-fe0c-444e-a498-691b108bbf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.411724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59385-fe0c-444e-a498-691b108bbf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.412490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59385-fe0c-444e-a498-691b108bbf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.414141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59385-fe0c-444e-a498-691b108bbf58 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.425190 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1241/2476] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:54:31.429353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.442318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3e1e-41fd-4c10-a97a-75d0adecd9ef admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.447893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.448908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.449326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.449727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] PATH_INFO: `/v3/projects/97cafcd59ef1433ba71a47a01b3a331c/users/8d1c7f32f0624210ae0ba52c022fea5a/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.464988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cafcd59ef1433ba71a47a01b3a331c, user_id=8d1c7f32f0624210ae0ba52c022fea5a, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.467907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.540048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1236/2477] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:54:31 2022] PUT /identity/v3/projects/97cafcd59ef1433ba71a47a01b3a331c/users/8d1c7f32f0624210ae0ba52c022fea5a/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:54:31.546084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.546340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.546655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.566914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:31.568187 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:31.632152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1242/2478] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:31.641542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.646327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:31.665730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:31.712934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411722c-9ba6-4353-be0a-b1cadb8a7043 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.718444 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b2941-9601-43d1-b563-0282b3b116fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.719282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2941-9601-43d1-b563-0282b3b116fb service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.719850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2941-9601-43d1-b563-0282b3b116fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.720291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2941-9601-43d1-b563-0282b3b116fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.734535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b2941-9601-43d1-b563-0282b3b116fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.736176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b2941-9601-43d1-b563-0282b3b116fb service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.747911 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1237/2479] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:54:31.782125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:31.783903 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:31.874095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ef21-4dcb-47b2-91bf-b64ab5e5d18c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:31.881537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:31.882763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:31.883606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:31.883963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:31.886284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:31.899959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:31.901590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:31.907707 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:31.925488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1243/2480] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:32.057481 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6e5cc-2457-434b-a2c5-c93a6c6b8aa9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:32.057945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6e5cc-2457-434b-a2c5-c93a6c6b8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:32.058045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6e5cc-2457-434b-a2c5-c93a6c6b8aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:32.077684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e4c6e5cc-2457-434b-a2c5-c93a6c6b8aa9 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:32.078933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e4c6e5cc-2457-434b-a2c5-c93a6c6b8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:32.144362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1238/2481] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:54:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:32.299699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:32.301140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:32.373824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67954-1d0f-455b-b155-24abb6e78b43 service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:32.379892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:32.380621 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:32.380855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:32.381141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:32.390819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:32.392475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:32.402111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1244/2482] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:54:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:54:39.012407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6609e8f-c04d-43ac-a77a-6c2fc655c783 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:39.015636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6609e8f-c04d-43ac-a77a-6c2fc655c783 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:39.017075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6609e8f-c04d-43ac-a77a-6c2fc655c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:39.063794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e6609e8f-c04d-43ac-a77a-6c2fc655c783 None None] MFA Rules not processed for user `8d1c7f32f0624210ae0ba52c022fea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:39.068733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e6609e8f-c04d-43ac-a77a-6c2fc655c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:39.207299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1239/2483] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:39.214518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:39.216576 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:39.236309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfd189-c3f7-406c-9e08-1f83780a8da5 service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:39.242530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:39.243314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:39.243681 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:39.244033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:39.254364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:39.256123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:39.269996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1245/2484] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:42.559472 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13a54c-c31c-4539-8aa2-f29e421f0b3d None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:42.567658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13a54c-c31c-4539-8aa2-f29e421f0b3d None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:42.567658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13a54c-c31c-4539-8aa2-f29e421f0b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:42.582731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ab13a54c-c31c-4539-8aa2-f29e421f0b3d None None] MFA Rules not processed for user `8d1c7f32f0624210ae0ba52c022fea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:42.584477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ab13a54c-c31c-4539-8aa2-f29e421f0b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:42.599145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1240/2485] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:54:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:43.012414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:43.023033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a42ae-1a89-446b-84ec-b3902b2c9a41 service nova] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:43.027819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:43.028544 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:43.028908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:43.030056 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:43.032197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:43.043770 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:43.046310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:43.064993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1246/2486] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:54:52.575583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=80 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:53.052357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=45 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:54.090656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bacfe-7ff2-4ab1-bb80-39703575b71e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:54.091127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bacfe-7ff2-4ab1-bb80-39703575b71e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:54.095080 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bacfe-7ff2-4ab1-bb80-39703575b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:54.120989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-109bacfe-7ff2-4ab1-bb80-39703575b71e None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:54:54.122404 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-109bacfe-7ff2-4ab1-bb80-39703575b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:54:54.130924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1241/2487] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:54:54.143019 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:54:54.155699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633562-a1ea-43c6-a3e3-70c7d9359d25 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:54:54.160794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a7aba-a1bb-4229-ac49-99ddb945de2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:54:54.161469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a7aba-a1bb-4229-ac49-99ddb945de2e service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:54:54.161757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a7aba-a1bb-4229-ac49-99ddb945de2e service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:54:54.162035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a7aba-a1bb-4229-ac49-99ddb945de2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:54:54.171405 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a7aba-a1bb-4229-ac49-99ddb945de2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:54:54.173084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a7aba-a1bb-4229-ac49-99ddb945de2e service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:54:54.181940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1247/2488] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:54:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:55:04.104718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:04.179113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=6 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:11.294498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65baa-e268-437e-ab05-8319d47ffeac None None] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:11.295018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65baa-e268-437e-ab05-8319d47ffeac None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:11.295124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65baa-e268-437e-ab05-8319d47ffeac None None] PATH_INFO: `/` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:11.297567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1242/2489] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:55:11.304063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d0f3-3b94-4ce1-ac44-57121035043f None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:11.304568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d0f3-3b94-4ce1-ac44-57121035043f None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:11.304568 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d0f3-3b94-4ce1-ac44-57121035043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:11.334507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7cd1d0f3-3b94-4ce1-ac44-57121035043f None None] MFA Rules not processed for user `1097be6c3ab44dd1a3532926235e980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:11.335936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7cd1d0f3-3b94-4ce1-ac44-57121035043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:11.343389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1248/2490] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:11.355808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65baa-e268-437e-ab05-8319d47ffeac None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:11.358621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-aea65baa-e268-437e-ab05-8319d47ffeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:11.373038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65baa-e268-437e-ab05-8319d47ffeac None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:11.377327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9b118-714b-42f2-8859-d8bdbc62169b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:11.378065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b118-714b-42f2-8859-d8bdbc62169b service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:11.378423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b118-714b-42f2-8859-d8bdbc62169b service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:11.378774 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9b118-714b-42f2-8859-d8bdbc62169b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:11.387100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9b118-714b-42f2-8859-d8bdbc62169b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:11.388793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9b118-714b-42f2-8859-d8bdbc62169b service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:11.398396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1243/2491] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:11.491388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f989b-27a6-41e3-8338-8af6e11e3538 None None] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:11.491679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f989b-27a6-41e3-8338-8af6e11e3538 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:11.491960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f989b-27a6-41e3-8338-8af6e11e3538 None None] PATH_INFO: `/` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:11.493501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1249/2492] 10.222.0.70 () {54 vars in 921 bytes} [Tue Jun 21 16:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:55:11.498929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea029ac-9615-4c9e-adf6-4431d4a24888 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:11.499223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea029ac-9615-4c9e-adf6-4431d4a24888 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:11.499514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea029ac-9615-4c9e-adf6-4431d4a24888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:11.518121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-eea029ac-9615-4c9e-adf6-4431d4a24888 None None] MFA Rules not processed for user `9687c85240694148aa572d8807ada25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:11.519318 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-eea029ac-9615-4c9e-adf6-4431d4a24888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:11.528718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1244/2493] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Jun 21 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:55:11.539842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f989b-27a6-41e3-8338-8af6e11e3538 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:11.552985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f989b-27a6-41e3-8338-8af6e11e3538 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:11.561270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:11.561270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:11.561270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:11.561270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:11.572785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:11.574261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:11.587229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1250/2494] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:13.205501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a984-dad8-4063-afba-d0e9b6758bfb None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:13.205501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a984-dad8-4063-afba-d0e9b6758bfb None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:13.206311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a984-dad8-4063-afba-d0e9b6758bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:13.225957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-cd78a984-dad8-4063-afba-d0e9b6758bfb None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:13.227201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cd78a984-dad8-4063-afba-d0e9b6758bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:13.236399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1245/2495] 10.222.0.70 () {58 vars in 967 bytes} [Tue Jun 21 16:55:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:13.250000 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:13.269225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec056-f7f2-4be6-ac87-d3e736496ff8 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:13.275541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:13.276196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:13.276489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:13.276794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:13.286783 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:13.288413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:13.296977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1251/2496] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:55:17.408840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:17.409398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:17.409497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:17.427305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] MFA Rules not processed for user `0ebe6382afe24ef489261081e8610271`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:17.428510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:17.482815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1246/2497] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:23.293999 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=15 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:27.476135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=37 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:37.977943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:37.988915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432ddfb-a311-400c-87d9-2fce92abffc4 service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:37.992737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:37.993497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:37.993789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:37.994074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:37.995905 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:38.009205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:38.010698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:38.021803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1252/2498] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:39.876925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:39.893532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4de479-7d1b-4aba-b140-1edef41f191b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:39.899758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:39.900791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:39.901313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:39.901806 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:39.903924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:39.918575 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:39.920247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:39.934346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1247/2499] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:42.533812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:42.535347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:42.606639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3fb9-a30c-4631-bcbd-f03d80c349c5 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:42.612735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:42.618426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:42.618426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:42.618426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:42.618426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:42.629218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:42.631139 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:42.648400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1253/2500] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:42.649422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:42.650857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:42.681966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91531980-dc75-4a63-bcf4-624cf52d7900 service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:42.684064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:42.685215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:42.685633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:42.685984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] PATH_INFO: `/v3/users/52ad18360dc64d2ea85cc950c9daa723` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:42.687273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ad18360dc64d2ea85cc950c9daa723)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:42.690185 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:42.872478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ad18360dc64d2ea85cc950c9daa723'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:42.880093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ad18360dc64d2ea85cc950c9daa723'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:42.880752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ad18360dc64d2ea85cc950c9daa723'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:42.881386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ad18360dc64d2ea85cc950c9daa723'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:42.952792 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-494c20e5-e8f5-4ec5-bed7-44f8c629c420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ad18360dc64d2ea85cc950c9daa723'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:42.971741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1248/2501] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:55:42 2022] DELETE /identity/v3/users/52ad18360dc64d2ea85cc950c9daa723 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:43.274207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:43.287587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f0a63-5429-411a-9400-05ae74b76ce6 service placement] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:43.347351 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:43.348214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:43.348505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:43.348789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] PATH_INFO: `/v3/projects/0a35c2bcb0e44e0ab3751a83635424e8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:43.349994 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a35c2bcb0e44e0ab3751a83635424e8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:43.351930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:43.465010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a35c2bcb0e44e0ab3751a83635424e8', 'request_id': 'req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:43.471244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a35c2bcb0e44e0ab3751a83635424e8', 'request_id': 'req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:43.477574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a35c2bcb0e44e0ab3751a83635424e8', 'request_id': 'req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:43.555277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] The token cache is being invalidate because project 0a35c2bcb0e44e0ab3751a83635424e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:55:43.555900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:43.556149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-258b9bcc-85f8-4b17-b967-2d9a4eb0af00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:43.557763 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1254/2502] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:55:43 2022] DELETE /identity/v3/projects/0a35c2bcb0e44e0ab3751a83635424e8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:43.562854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:43.563691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:43.566460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:43.585159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:43.586414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:43.647655 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1249/2503] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:43.655674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:43.656092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:43.656476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:43.669580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:43.675625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:43.676839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:43.684986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1255/2504] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:43.690430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:43.700579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a29134-8a0a-49b9-a029-f32816831c7e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:43.705937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:43.709631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:43.709631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:43.709631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:43.709631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:55:43.709631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:43.710166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:43.723506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1250/2505] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:55:43.729455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:43.742356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc655f29-e00b-48f4-934b-445ca9be746b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:43.748089 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:43.748742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:43.749038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:43.749355 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:43.750047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:43.752505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:43.848585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1256/2506] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:55:43 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:43.852779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:43.863437 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020784f-e50e-4a97-b3d3-9d26ea11f861 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:43.909124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:43.921869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:43.927302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:43.927302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:43.927302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:43.927302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:43.927302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.045074 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1251/2507] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:55:43 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:44.050191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.062749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e93f0-8a52-4677-a350-734dedacc602 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.068274 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.068936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.069228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.069535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.070276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.071894 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.085434 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1257/2508] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:44.086651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.097337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240737c-2433-421f-a8d4-833a36e60c04 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.102132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308425cb-cdbf-45ee-90d8-3f7bafd3ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.102928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308425cb-cdbf-45ee-90d8-3f7bafd3ca4d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.103382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308425cb-cdbf-45ee-90d8-3f7bafd3ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.103956 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308425cb-cdbf-45ee-90d8-3f7bafd3ca4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.104688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308425cb-cdbf-45ee-90d8-3f7bafd3ca4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.106321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308425cb-cdbf-45ee-90d8-3f7bafd3ca4d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.117808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1252/2509] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:44.122134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.133414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038335b6-381d-49db-ac0d-e81121c6a5bb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.138208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.139042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.139349 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.139616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] PATH_INFO: `/v3/projects/b811188d636a406e8a5322e383fb71b9/users/165dc2d42b154fa598491a85ba173757/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.155225 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b811188d636a406e8a5322e383fb71b9, user_id=165dc2d42b154fa598491a85ba173757, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.158034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.233078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1258/2510] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:55:44 2022] PUT /identity/v3/projects/b811188d636a406e8a5322e383fb71b9/users/165dc2d42b154fa598491a85ba173757/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:44.244953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.245252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.245586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.276952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] MFA Rules not processed for user `165dc2d42b154fa598491a85ba173757`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:44.278229 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:44.343412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1253/2511] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:44.348787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.413543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bdf8b-d71d-4ddb-9d34-e79ac2ada9a6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.418223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.418882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.419169 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.419451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.420149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.422103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.522835 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1259/2512] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:55:44 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:44.527038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.538719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392fcb1-fe65-4a2b-bf40-a449cf16704e None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.602682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.603364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.603653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.603972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.604859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.606899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.722381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1254/2513] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:55:44 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:44.727270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.737716 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344692b-9eb3-4006-9a2f-351198d804bc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.742382 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.743050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.743341 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.743627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.744357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.746039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.758605 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1260/2514] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:44.762985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.774166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fd371-80fb-4de0-9bbf-cb50064f0955 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.778941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.779830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.780118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.780401 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] PATH_INFO: `/v3/projects/3d88186b39de495db310a7d8ac9df274/users/51496bdf302d483a9e49c7897fad8dff/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.796355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d88186b39de495db310a7d8ac9df274, user_id=51496bdf302d483a9e49c7897fad8dff, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:44.799199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:44.924871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1255/2515] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:55:44 2022] PUT /identity/v3/projects/3d88186b39de495db310a7d8ac9df274/users/51496bdf302d483a9e49c7897fad8dff/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:44.928971 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:44.939014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07815-a727-49fb-b5e2-0def3d3d1daa admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:44.997462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013a9aa-c598-4761-933a-a981adc91371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:44.998046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a9aa-c598-4761-933a-a981adc91371 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:44.998329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a9aa-c598-4761-933a-a981adc91371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:44.998609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a9aa-c598-4761-933a-a981adc91371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:44.999330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013a9aa-c598-4761-933a-a981adc91371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:45.000946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013a9aa-c598-4761-933a-a981adc91371 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:45.012550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1261/2516] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:45.016720 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:45.027888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28eebc-ba7d-4791-a0b7-3002bfdc3f36 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:45.032530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:45.034055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:45.034348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:45.034629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] PATH_INFO: `/v3/projects/3d88186b39de495db310a7d8ac9df274/users/51496bdf302d483a9e49c7897fad8dff/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:45.036658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d88186b39de495db310a7d8ac9df274, user_id=51496bdf302d483a9e49c7897fad8dff, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:45.039342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:45.050510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1256/2517] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:55:45 2022] PUT /identity/v3/projects/3d88186b39de495db310a7d8ac9df274/users/51496bdf302d483a9e49c7897fad8dff/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:45.061008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:45.061337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:45.061627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:45.068627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:45.089458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] MFA Rules not processed for user `51496bdf302d483a9e49c7897fad8dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:45.090834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:45.166008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1262/2518] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:45.179650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:45.181522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:45.191709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:45.240303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e41f-5ef8-411f-9750-10be9bb6e14f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:45.244265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:45.244955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:45.245249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:45.245564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:45.255632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:45.257048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:45.268320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1257/2519] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:46.308068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:46.319121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb4e54-64b2-4c32-a711-930f92f6b24b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:46.324077 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51496bdf302d483a9e49c7897fad8dff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d88186b39de495db310a7d8ac9df274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:46.324755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:46.325072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:46.325400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:46.326174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:55:46.326508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:46.328150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:46.340168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1263/2520] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:55:46.344623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:46.354368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519187a5-cc2c-401f-804e-89cfc6771686 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:46.359252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51496bdf302d483a9e49c7897fad8dff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d88186b39de495db310a7d8ac9df274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:46.359899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:46.360191 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:46.360484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:46.361188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:46.363748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:46.465780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1258/2521] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:55:46 2022] POST /identity/v3/projects => generated 353 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:46.469664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:46.481022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4270c5-1457-45e6-9783-05bca024ac18 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:46.538587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51496bdf302d483a9e49c7897fad8dff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d88186b39de495db310a7d8ac9df274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:46.539257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:46.539552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:46.539843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:46.540578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:55:46.540898 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:46.542550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:46.554982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1264/2522] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:55:46.591429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:46.603075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052ef2-c544-489b-85b1-7d644e6119c3 tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:46.608089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51496bdf302d483a9e49c7897fad8dff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d88186b39de495db310a7d8ac9df274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:46.608958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:46.609250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:46.609563 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] PATH_INFO: `/v3/projects/d59170ec97cb4a4786084236f6ee03c9` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:46.610773 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d59170ec97cb4a4786084236f6ee03c9)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:46.613365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:46.716236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59170ec97cb4a4786084236f6ee03c9', 'request_id': 'req-3d4a989a-0a72-43a4-91f9-442d9898995a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:46.787003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59170ec97cb4a4786084236f6ee03c9', 'request_id': 'req-3d4a989a-0a72-43a4-91f9-442d9898995a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:46.793227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59170ec97cb4a4786084236f6ee03c9', 'request_id': 'req-3d4a989a-0a72-43a4-91f9-442d9898995a'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:46.805705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] The token cache is being invalidate because project d59170ec97cb4a4786084236f6ee03c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:55:46.805997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:46.806676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d4a989a-0a72-43a4-91f9-442d9898995a tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:46.808251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1259/2523] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:55:46 2022] DELETE /identity/v3/projects/d59170ec97cb4a4786084236f6ee03c9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:47.468901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:47.470652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:47.536812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b6c10-1c2f-4d72-95ec-601613cbd6de tempest-VolumeQuotaClassesTest-1120789232 tempest-VolumeQuotaClassesTest-1120789232-project-admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:47.549064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:47.593742 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:47.594613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:47.594895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:47.595209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] PATH_INFO: `/v3/users/165dc2d42b154fa598491a85ba173757` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:47.597200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=165dc2d42b154fa598491a85ba173757)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:47.599209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:47.808727 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165dc2d42b154fa598491a85ba173757'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:47.815689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165dc2d42b154fa598491a85ba173757'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:47.816365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165dc2d42b154fa598491a85ba173757'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:47.816981 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165dc2d42b154fa598491a85ba173757'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:47.828843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165dc2d42b154fa598491a85ba173757'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:47.910281 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1265/2524] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:55:47 2022] DELETE /identity/v3/users/165dc2d42b154fa598491a85ba173757 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:47.914965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:47.915431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:47.915568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:47.933509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:47.934765 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:47.993810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1260/2525] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:55:48.004175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:48.005658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:48.063904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693548d-d508-4eac-b860-7e27b5f1de4e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:48.068446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:48.069094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:48.069415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:48.069699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:48.081421 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:48.082988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:48.092666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1266/2526] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:48.603275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:48.604803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:48.619095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6e1b-71e3-47fb-a22a-ddfbce4a5a12 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:48.623917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:48.624785 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:48.625588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:48.625588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] PATH_INFO: `/v3/projects/b811188d636a406e8a5322e383fb71b9` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:48.626645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b811188d636a406e8a5322e383fb71b9)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:48.629604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:48.636795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:48.762994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b811188d636a406e8a5322e383fb71b9', 'request_id': 'req-6957990b-970e-41d7-9f50-eaccbb947803'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:48.843878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b811188d636a406e8a5322e383fb71b9', 'request_id': 'req-6957990b-970e-41d7-9f50-eaccbb947803'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:48.853430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b811188d636a406e8a5322e383fb71b9', 'request_id': 'req-6957990b-970e-41d7-9f50-eaccbb947803'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:48.862628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] The token cache is being invalidate because project b811188d636a406e8a5322e383fb71b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:55:48.862953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:48.863662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:48.865231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1261/2527] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:55:48 2022] DELETE /identity/v3/projects/b811188d636a406e8a5322e383fb71b9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:48.869192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:48.879250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d06ddd-083d-48e9-b288-d120befd5e14 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:48.917786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:48.936378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:48.937266 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:48.937586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:48.937870 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] PATH_INFO: `/v3/users/51496bdf302d483a9e49c7897fad8dff` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:48.939073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51496bdf302d483a9e49c7897fad8dff)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:48.941036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:49.127940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51496bdf302d483a9e49c7897fad8dff'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:49.135092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51496bdf302d483a9e49c7897fad8dff'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:49.135769 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51496bdf302d483a9e49c7897fad8dff'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:49.136387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51496bdf302d483a9e49c7897fad8dff'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:49.156976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-dec13a28-2ebe-4f05-b370-e3a489222706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51496bdf302d483a9e49c7897fad8dff'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:49.271418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1267/2528] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:55:48 2022] DELETE /identity/v3/users/51496bdf302d483a9e49c7897fad8dff => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:49.716469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:49.717998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:49.731387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957990b-970e-41d7-9f50-eaccbb947803 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:49.791905 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:49.792771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:49.793110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:49.793439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] PATH_INFO: `/v3/projects/3d88186b39de495db310a7d8ac9df274` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:49.793439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d88186b39de495db310a7d8ac9df274)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:49.796559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:49.956649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d88186b39de495db310a7d8ac9df274', 'request_id': 'req-c3b621c4-e9d3-456f-89ec-acea69716b8c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:50.027293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d88186b39de495db310a7d8ac9df274', 'request_id': 'req-c3b621c4-e9d3-456f-89ec-acea69716b8c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:50.033238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d88186b39de495db310a7d8ac9df274', 'request_id': 'req-c3b621c4-e9d3-456f-89ec-acea69716b8c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:50.045386 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] The token cache is being invalidate because project 3d88186b39de495db310a7d8ac9df274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:55:50.045667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:50.046311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-c3b621c4-e9d3-456f-89ec-acea69716b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:50.047856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1262/2529] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:55:49 2022] DELETE /identity/v3/projects/3d88186b39de495db310a7d8ac9df274 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:50.053463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.054252 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.055655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.074186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:50.075397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:50.139608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1268/2530] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:50.149073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.149503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.149777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.168201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:50.169496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:50.178508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1263/2531] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:50.182912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:50.194448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60d2f-17a8-4f2e-b255-0fca85d675e0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:50.199148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:50.199882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.200217 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.200570 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.201389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:55:50.204267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:50.204267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:50.215466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1269/2532] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:55:50.219899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:50.230299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c444bf5-9df1-4f56-8a2e-b9d59704f752 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:50.234957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:50.235603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.235882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.236161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.236899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:50.239617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:50.254202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:50.374210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1264/2533] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:55:50 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:55:50.378465 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:50.388850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d375a-0a1c-4f36-9a13-ecfe57f55f0f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:50.434110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:50.447041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:50.447745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.448021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.448334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.449021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:50.451059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:50.549474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1270/2534] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:55:50 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:50.554320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:50.565685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6968f8-35b9-48b0-a2e0-cbac05ad6d77 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:50.570527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:50.571199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.571489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.571875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.572513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:50.574173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:50.586145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1265/2535] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:50.590228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:50.601668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191169a-b5aa-42de-91c7-7aedfb5c7e6e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:50.606484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f38bcf-8c5c-4617-8f1b-454bb8454038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:50.607175 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38bcf-8c5c-4617-8f1b-454bb8454038 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.607466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38bcf-8c5c-4617-8f1b-454bb8454038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.607752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38bcf-8c5c-4617-8f1b-454bb8454038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.608865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f38bcf-8c5c-4617-8f1b-454bb8454038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:50.610528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f38bcf-8c5c-4617-8f1b-454bb8454038 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:50.621668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1271/2536] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:50.626034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:50.636599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20f6e6-8cc8-4e77-895a-260d71518d88 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:50.641366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:50.642217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.642507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.642789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] PATH_INFO: `/v3/projects/d1f2782960ce4aaba27a20b7b590f96a/users/25c866a961164a78987dbd9ac9156db2/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.658994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f2782960ce4aaba27a20b7b590f96a, user_id=25c866a961164a78987dbd9ac9156db2, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:50.662398 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:50.829899 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1266/2537] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:55:50 2022] PUT /identity/v3/projects/d1f2782960ce4aaba27a20b7b590f96a/users/25c866a961164a78987dbd9ac9156db2/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:50.842324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:50.842618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:50.842928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:50.870861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] MFA Rules not processed for user `25c866a961164a78987dbd9ac9156db2`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:50.872102 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:50.937391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1272/2538] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:50.942316 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.002707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5067b2-6f8d-4a68-a19a-065beab40efb admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.008531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.009330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.009579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.009860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.010568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.012511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.162621 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1267/2539] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:55:50 2022] POST /identity/v3/projects => generated 401 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:51.166795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.178007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02a5f-f5aa-4994-87bb-5eedd8c24001 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.237583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.238320 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.238594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.238875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.239561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.241521 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.353962 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1273/2540] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:55:51 2022] POST /identity/v3/users => generated 307 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:55:51.357872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.368879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b19ee7-ae17-4282-9ef5-6f0b1a253e65 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.373841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.377658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.377658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.377658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.377658 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.378082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.390448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1268/2541] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:51.395180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.405839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ca9f-ec9a-4fc7-bb34-7e0d4ff0becc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.411178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.412050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.412332 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.412616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] PATH_INFO: `/v3/projects/4e8bda61fdf74738888d2a35c776f0a5/users/9ac58a69ac254f5aa10159d1894be735/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.428496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8bda61fdf74738888d2a35c776f0a5, user_id=9ac58a69ac254f5aa10159d1894be735, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.431186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.565050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1274/2542] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:55:51 2022] PUT /identity/v3/projects/4e8bda61fdf74738888d2a35c776f0a5/users/9ac58a69ac254f5aa10159d1894be735/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:51.569747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.579866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa504-fdd7-44eb-ba3a-e924fe7fab51 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.636567 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb13b0-377e-4453-9571-03ddf3b25e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.637232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb13b0-377e-4453-9571-03ddf3b25e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.637557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb13b0-377e-4453-9571-03ddf3b25e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.637837 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb13b0-377e-4453-9571-03ddf3b25e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.638555 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb13b0-377e-4453-9571-03ddf3b25e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.640159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb13b0-377e-4453-9571-03ddf3b25e43 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.650246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1269/2543] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:55:51.654393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.665049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96fdc-c75d-42da-a8e6-0f504681f83b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.669804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.670685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.670977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.671258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] PATH_INFO: `/v3/projects/4e8bda61fdf74738888d2a35c776f0a5/users/9ac58a69ac254f5aa10159d1894be735/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.673293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8bda61fdf74738888d2a35c776f0a5, user_id=9ac58a69ac254f5aa10159d1894be735, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.676715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.687029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1275/2544] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:55:51 2022] PUT /identity/v3/projects/4e8bda61fdf74738888d2a35c776f0a5/users/9ac58a69ac254f5aa10159d1894be735/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:51.698348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.698645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.698936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.726435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] MFA Rules not processed for user `9ac58a69ac254f5aa10159d1894be735`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:51.727652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:51.746815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:51.798216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1270/2545] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:51.810330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:51.812018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:51.823097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:51.876231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a404-b3a3-4ebc-a2e9-b6f859f8a701 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:51.882034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:51.882709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:51.882993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:51.883267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:51.892855 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:51.894579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:51.904357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1276/2546] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:52.182142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:52.192817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d44fb-87a4-4152-bba7-6dbb4f6a9b41 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:52.198310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0fbd-29a3-4687-9c54-d606ee8d3a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:52.198953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0fbd-29a3-4687-9c54-d606ee8d3a79 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:52.207405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0fbd-29a3-4687-9c54-d606ee8d3a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:52.207405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0fbd-29a3-4687-9c54-d606ee8d3a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:52.258477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0fbd-29a3-4687-9c54-d606ee8d3a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:52.259924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0fbd-29a3-4687-9c54-d606ee8d3a79 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:52.270434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1271/2547] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:57.794666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:57.869363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1974079-ac84-49e6-9740-3cd66cdef428 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:57.875059 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:57.875950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:57.876241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:57.876526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] PATH_INFO: `/v3/users/25c866a961164a78987dbd9ac9156db2` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:57.877822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c866a961164a78987dbd9ac9156db2)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:57.880220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:58.121945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c866a961164a78987dbd9ac9156db2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:58.130228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c866a961164a78987dbd9ac9156db2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:58.131261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c866a961164a78987dbd9ac9156db2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:58.131922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c866a961164a78987dbd9ac9156db2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:58.144684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c866a961164a78987dbd9ac9156db2'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:58.233722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1277/2548] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:55:57 2022] DELETE /identity/v3/users/25c866a961164a78987dbd9ac9156db2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:58.239048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:58.239735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:58.239735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:58.259306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:55:58.260730 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:58.330542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1272/2549] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:55:58.341749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:58.343251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:58.386350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:58.415179 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a88d9-5918-470f-ac91-b42ecce6fd2e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:58.421514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:58.421514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:58.421514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:58.421514 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:58.430653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:58.432105 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:58.443157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1278/2550] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:55:59.083387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:59.085117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:55:59.106385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232df42-3404-4366-b252-e7d3882e6ddc None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:59.127370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:59.128361 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:59.129507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:59.129860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] PATH_INFO: `/v3/projects/d1f2782960ce4aaba27a20b7b590f96a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:59.131939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f2782960ce4aaba27a20b7b590f96a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:59.134012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:59.369250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f2782960ce4aaba27a20b7b590f96a', 'request_id': 'req-a98b6624-c605-41e7-ac21-61cb500eb34c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.371744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:59.468221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f2782960ce4aaba27a20b7b590f96a', 'request_id': 'req-a98b6624-c605-41e7-ac21-61cb500eb34c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.477872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f2782960ce4aaba27a20b7b590f96a', 'request_id': 'req-a98b6624-c605-41e7-ac21-61cb500eb34c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.496140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] The token cache is being invalidate because project d1f2782960ce4aaba27a20b7b590f96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:55:59.496638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.497466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.501348 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1273/2551] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:55:59 2022] DELETE /identity/v3/projects/d1f2782960ce4aaba27a20b7b590f96a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:55:59.504085 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:55:59.515233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66ef5-7c39-4672-b282-800dd61633ab service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:55:59.589051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:55:59.590436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:55:59.590827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:55:59.591245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] PATH_INFO: `/v3/users/9ac58a69ac254f5aa10159d1894be735` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:55:59.593344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac58a69ac254f5aa10159d1894be735)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:55:59.595904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:55:59.805484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac58a69ac254f5aa10159d1894be735'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.809755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac58a69ac254f5aa10159d1894be735'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.810487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac58a69ac254f5aa10159d1894be735'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.811150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac58a69ac254f5aa10159d1894be735'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.830475 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3061d9ea-3577-4b02-ad1a-84fdc884a6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac58a69ac254f5aa10159d1894be735'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:55:59.933211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1279/2552] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:55:59 2022] DELETE /identity/v3/users/9ac58a69ac254f5aa10159d1894be735 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:00.426532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:00.428055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:00.442125 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b6624-c605-41e7-ac21-61cb500eb34c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:00.505526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:00.506586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:00.506880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:00.507166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] PATH_INFO: `/v3/projects/4e8bda61fdf74738888d2a35c776f0a5` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:00.508539 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8bda61fdf74738888d2a35c776f0a5)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:00.510577 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:00.678392 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8bda61fdf74738888d2a35c776f0a5', 'request_id': 'req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:00.793342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8bda61fdf74738888d2a35c776f0a5', 'request_id': 'req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:00.799476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8bda61fdf74738888d2a35c776f0a5', 'request_id': 'req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:00.811487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] The token cache is being invalidate because project 4e8bda61fdf74738888d2a35c776f0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:00.811776 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:00.812436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-77a1d9f7-749b-40ad-82e4-b2ce52c0fdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:00.814035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1274/2553] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:00 2022] DELETE /identity/v3/projects/4e8bda61fdf74738888d2a35c776f0a5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:00.819004 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:00.819473 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:00.819580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:00.837645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:00.839016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:00.887226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:00.902209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1280/2554] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:00.911044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:00.911336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:00.911619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:00.930667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:00.931866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:00.940167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1275/2555] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:00.945133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:00.955107 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d9741-e408-49e8-aed5-511c05fa5a72 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:00.960204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:00.960873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:00.961163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:00.961489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:00.962228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:00.962543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:00.964208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:00.980171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1281/2556] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:56:00.984442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:00.997435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd056737-9273-46f9-8f0a-f892d1d66579 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.002532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.003209 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.003501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.004089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.004866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.006910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:01.143848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1276/2557] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:00 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:01.148493 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:01.158495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f380-a945-4f18-b1d4-f3e47ae9edcd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.217189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.217891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.218183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.218469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.219170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.221103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:01.337162 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1282/2558] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:01 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:01.338714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:01.350093 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db162546-2d34-492d-9465-0cbd4a7671d8 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.354935 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.355617 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.355907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.356193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.356929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.358573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:01.369879 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1277/2559] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:01.374586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:01.386112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ccb27-f92c-4fdd-bb37-7c336a18ebbb admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.390897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d50f86-8bb3-4bf1-9073-02bdc5ce4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.391642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50f86-8bb3-4bf1-9073-02bdc5ce4775 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.391978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50f86-8bb3-4bf1-9073-02bdc5ce4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.392541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50f86-8bb3-4bf1-9073-02bdc5ce4775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.393687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d50f86-8bb3-4bf1-9073-02bdc5ce4775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.396637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d50f86-8bb3-4bf1-9073-02bdc5ce4775 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:01.411156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1283/2560] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:01.412409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:01.422408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc90b4-ecf6-43fe-a79a-7464a6d6cee3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.427331 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.428221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.428509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.428787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] PATH_INFO: `/v3/projects/5a45971dceaa40268e61fb81a0879d21/users/4f65c106dccb4f8498f727d0d46fe3b1/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.444633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a45971dceaa40268e61fb81a0879d21, user_id=4f65c106dccb4f8498f727d0d46fe3b1, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.447263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:01.610722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1278/2561] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:01 2022] PUT /identity/v3/projects/5a45971dceaa40268e61fb81a0879d21/users/4f65c106dccb4f8498f727d0d46fe3b1/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:01.622865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.623156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.623437 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.658940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] MFA Rules not processed for user `4f65c106dccb4f8498f727d0d46fe3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:01.660300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:01.727506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1284/2562] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:01.732715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:01.740226 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:01.800893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09189d-5638-4623-a3cd-3fe90de0eda9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.805931 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.806620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.806910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.807193 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.808037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.810061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:01.906558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1279/2563] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:01 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:56:01.910704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:01.922003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e5bac-3dff-4ea9-ac3a-42008f5b7404 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:01.970359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:01.988625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:01.988625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:01.988625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:01.988625 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:01.989428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:01.989428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.102283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1285/2564] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:01 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:02.103831 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:02.115362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547303c-afca-4101-8f12-19602a8c0b08 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:02.120008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:02.120661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.120945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.121223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.121974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:02.123589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.140162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1280/2565] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:02.144501 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:02.156461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd66d-c170-4864-81f4-83b81be0f2f5 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:02.161522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:02.162387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.162684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.162968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] PATH_INFO: `/v3/projects/167bd2092be24ac69ac8572ef890ac96/users/fc83925602784cdca99fa3807e6d8656/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.179415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=167bd2092be24ac69ac8572ef890ac96, user_id=fc83925602784cdca99fa3807e6d8656, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:02.182272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.319566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1286/2566] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:02 2022] PUT /identity/v3/projects/167bd2092be24ac69ac8572ef890ac96/users/fc83925602784cdca99fa3807e6d8656/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:02.323968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:02.334468 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d84c15-7180-4fb3-a8ec-95e3120cc422 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:02.390801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ee6b-eb7e-46e4-8aea-889fcfb53ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:02.391466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ee6b-eb7e-46e4-8aea-889fcfb53ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.391756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ee6b-eb7e-46e4-8aea-889fcfb53ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.392037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ee6b-eb7e-46e4-8aea-889fcfb53ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.392794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851ee6b-eb7e-46e4-8aea-889fcfb53ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:02.394448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851ee6b-eb7e-46e4-8aea-889fcfb53ac6 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.404508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1281/2567] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:02.408867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:02.419951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53842-1801-49ab-90b9-810ae958ec5a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:02.424546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:02.425454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.425749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.426718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] PATH_INFO: `/v3/projects/167bd2092be24ac69ac8572ef890ac96/users/fc83925602784cdca99fa3807e6d8656/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.428814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167bd2092be24ac69ac8572ef890ac96, user_id=fc83925602784cdca99fa3807e6d8656, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:02.431513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.442635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1287/2568] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:02 2022] PUT /identity/v3/projects/167bd2092be24ac69ac8572ef890ac96/users/fc83925602784cdca99fa3807e6d8656/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:02.467606 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.468100 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.468299 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.501029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] MFA Rules not processed for user `fc83925602784cdca99fa3807e6d8656`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:02.502400 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:02.568648 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:02.572358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1282/2569] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:02.583970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:02.585758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:02.647173 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b6f9-6063-48f2-9fdf-031124f9da53 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:02.651017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:02.651669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.652016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.652284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.662964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:02.664450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.674591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1288/2570] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:02.773822 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:02.783637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9961fe9-f781-459f-b906-343a1b1c3dab None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:02.787983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:02.788626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:02.788917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:02.789199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:02.846747 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:02.848884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:02.857993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1283/2571] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:05.053506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:05.054942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:05.112925 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6f08-20dd-4e17-83f3-9bd7aadfe088 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:05.117756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:05.118267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:05.118602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:05.118860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:05.120712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:05.176601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:05.188711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:05.190278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df798bc-8c4c-4571-af8a-5c6518e976d0 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:05.201649 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1289/2572] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:06.429037 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:06.433860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8d684-67f5-416a-aebc-f412e43f4f17 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:06.439151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:06.440522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:06.440819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:06.441104 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] PATH_INFO: `/v3/users/4f65c106dccb4f8498f727d0d46fe3b1` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:06.442494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f65c106dccb4f8498f727d0d46fe3b1)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:06.444440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:06.678106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f65c106dccb4f8498f727d0d46fe3b1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:06.686983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f65c106dccb4f8498f727d0d46fe3b1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:06.687891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f65c106dccb4f8498f727d0d46fe3b1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:06.688631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f65c106dccb4f8498f727d0d46fe3b1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:06.787630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f65c106dccb4f8498f727d0d46fe3b1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:06.806910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1284/2573] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:06 2022] DELETE /identity/v3/users/4f65c106dccb4f8498f727d0d46fe3b1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:06.811497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30076-852b-498b-b349-03117f891f94 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:06.812007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30076-852b-498b-b349-03117f891f94 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:06.812106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30076-852b-498b-b349-03117f891f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:06.830124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2ff30076-852b-498b-b349-03117f891f94 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:06.831452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2ff30076-852b-498b-b349-03117f891f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:06.896454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1290/2574] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:06.906708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:06.908168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:06.998581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867e07-1661-4555-9911-b006e821993b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:07.003941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:07.008283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:07.008283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:07.008283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:07.028312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:07.030793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:07.047754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1285/2575] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:56:07.695316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30076-852b-498b-b349-03117f891f94 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:07.697007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2ff30076-852b-498b-b349-03117f891f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:07.711404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30076-852b-498b-b349-03117f891f94 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:07.716334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:07.717192 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:07.717512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:07.717897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] PATH_INFO: `/v3/projects/5a45971dceaa40268e61fb81a0879d21` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:07.718982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a45971dceaa40268e61fb81a0879d21)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:07.721084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:07.948801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a45971dceaa40268e61fb81a0879d21', 'request_id': 'req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:07.960933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a45971dceaa40268e61fb81a0879d21', 'request_id': 'req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:07.983438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a45971dceaa40268e61fb81a0879d21', 'request_id': 'req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.126798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] The token cache is being invalidate because project 5a45971dceaa40268e61fb81a0879d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:08.127155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.127827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.134480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:08.135271 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1291/2576] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:07 2022] DELETE /identity/v3/projects/5a45971dceaa40268e61fb81a0879d21 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:08.154810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e247d61-33ee-4475-874d-a09f22021bef service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:08.160794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:08.235225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:08.235225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:08.235225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:08.235225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] PATH_INFO: `/v3/users/fc83925602784cdca99fa3807e6d8656` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:08.235889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc83925602784cdca99fa3807e6d8656)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:08.236496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:08.447182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc83925602784cdca99fa3807e6d8656'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.454067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc83925602784cdca99fa3807e6d8656'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.454675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc83925602784cdca99fa3807e6d8656'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.455283 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc83925602784cdca99fa3807e6d8656'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.524338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc83925602784cdca99fa3807e6d8656'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:08.544046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1286/2577] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:08 2022] DELETE /identity/v3/users/fc83925602784cdca99fa3807e6d8656 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:56:09.194947 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:09.196560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:09.211038 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2abaa-8bfd-4cd7-aff6-3c61e0efbd75 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:09.291812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:09.292931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.293047 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.293316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] PATH_INFO: `/v3/projects/167bd2092be24ac69ac8572ef890ac96` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.294699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167bd2092be24ac69ac8572ef890ac96)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:09.296608 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:09.315443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:09.394043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:09.397202 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:09.421446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2f38-c908-4841-b4b9-2a10c7fd8b66 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:09.428412 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:09.432164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.432164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.432164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] PATH_INFO: `/v3/users/a25a52e592a34cd48a8c88304501c047` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.432164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25a52e592a34cd48a8c88304501c047)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:09.435287 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:09.474944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167bd2092be24ac69ac8572ef890ac96', 'request_id': 'req-3e0949ab-7869-4a33-ab06-f96012b56197'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.480895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167bd2092be24ac69ac8572ef890ac96', 'request_id': 'req-3e0949ab-7869-4a33-ab06-f96012b56197'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.487282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167bd2092be24ac69ac8572ef890ac96', 'request_id': 'req-3e0949ab-7869-4a33-ab06-f96012b56197'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.577684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] The token cache is being invalidate because project 167bd2092be24ac69ac8572ef890ac96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:09.577977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.578718 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3e0949ab-7869-4a33-ab06-f96012b56197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.580306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1292/2578] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:09 2022] DELETE /identity/v3/projects/167bd2092be24ac69ac8572ef890ac96 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:09.586174 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6940-b4f4-4356-990c-f07437dd16ba None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.586463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6940-b4f4-4356-990c-f07437dd16ba None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.586774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6940-b4f4-4356-990c-f07437dd16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.605908 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8dfe6940-b4f4-4356-990c-f07437dd16ba None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:09.607116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8dfe6940-b4f4-4356-990c-f07437dd16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:09.666050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1293/2579] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:09.675228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.675520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.676146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.696828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25a52e592a34cd48a8c88304501c047'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.698822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:09.699596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:09.705645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25a52e592a34cd48a8c88304501c047'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.707908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25a52e592a34cd48a8c88304501c047'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.707908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25a52e592a34cd48a8c88304501c047'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.709978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1294/2580] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:09.714560 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:09.724611 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb10e1-f3c2-4c7e-a4f2-fd384faee934 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:09.729737 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:09.730063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.730352 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.730669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.731406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:09.731722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:09.733362 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:09.745377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1295/2581] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:56:09.749794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:09.751496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:09.765642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46313-39c6-4d5d-97c2-c2e88aed8366 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:09.771588 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:09.772250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.772658 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.772945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.773690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:09.775825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:09.793220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25a52e592a34cd48a8c88304501c047'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:09.812853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1287/2582] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:09 2022] DELETE /identity/v3/users/a25a52e592a34cd48a8c88304501c047 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:09.858205 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1296/2583] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:09 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:56:09.859645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:09.866028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:09.929317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66021868-e351-4232-8c5d-c59376a4b147 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:09.994871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:09.995584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:09.996012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:09.996303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:09.997022 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:09.999018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.092189 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.093953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.107508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6a6f-9b24-47ed-8f4e-96ae28b3d9d6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.112109 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.114897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.114897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.114897 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] PATH_INFO: `/v3/projects/85cd0d0402244286b9199e77f8ef18ca` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.115182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85cd0d0402244286b9199e77f8ef18ca)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.116983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.144310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1288/2584] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:09 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:10.144310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.154554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cb6b-6c5a-44ef-a9ca-198a3947705b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.159288 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487084-2b1f-4d74-b68a-72079b03f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.159947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487084-2b1f-4d74-b68a-72079b03f792 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.160858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487084-2b1f-4d74-b68a-72079b03f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.161574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487084-2b1f-4d74-b68a-72079b03f792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.161995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76487084-2b1f-4d74-b68a-72079b03f792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.163639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76487084-2b1f-4d74-b68a-72079b03f792 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.174163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1289/2585] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:56:10.177032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.177032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.177032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.194098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] MFA Rules not processed for user `8d1c7f32f0624210ae0ba52c022fea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:10.195360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.250383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1290/2586] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:10.251140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.263915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2798-7dc7-4470-93c2-1bd2446598d8 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.269101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.270895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.270895 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.271136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.271900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.273612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1291/2587] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:10.293967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.299530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7710cb-c9ee-48c4-a806-83462bc4a17a admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.304387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b3f3a-1e4f-43a9-add2-fed6a157ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.305352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3f3a-1e4f-43a9-add2-fed6a157ba91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.305642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3f3a-1e4f-43a9-add2-fed6a157ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.305917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3f3a-1e4f-43a9-add2-fed6a157ba91 admin admin] PATH_INFO: `/v3/projects/87dd6fc4788645028e6847a1d0d1badd/users/3f49deb14e7e47d2a0d52e6d3dcb264e/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.325146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b3f3a-1e4f-43a9-add2-fed6a157ba91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87dd6fc4788645028e6847a1d0d1badd, user_id=3f49deb14e7e47d2a0d52e6d3dcb264e, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.327919 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b3f3a-1e4f-43a9-add2-fed6a157ba91 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.335940 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85cd0d0402244286b9199e77f8ef18ca', 'request_id': 'req-08e69f45-79dd-4552-9acc-c63e9d754b5c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:10.342237 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85cd0d0402244286b9199e77f8ef18ca', 'request_id': 'req-08e69f45-79dd-4552-9acc-c63e9d754b5c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:10.349813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85cd0d0402244286b9199e77f8ef18ca', 'request_id': 'req-08e69f45-79dd-4552-9acc-c63e9d754b5c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:10.521510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] The token cache is being invalidate because project 85cd0d0402244286b9199e77f8ef18ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:10.521856 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:10.522614 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1292/2588] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:10 2022] PUT /identity/v3/projects/87dd6fc4788645028e6847a1d0d1badd/users/3f49deb14e7e47d2a0d52e6d3dcb264e/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:56:10.523083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-08e69f45-79dd-4552-9acc-c63e9d754b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:10.524800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1297/2589] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:10 2022] DELETE /identity/v3/projects/85cd0d0402244286b9199e77f8ef18ca => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:56:10.536477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ab8f-e234-4e04-9b5a-74908ee7d864 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.536815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ab8f-e234-4e04-9b5a-74908ee7d864 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.537112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ab8f-e234-4e04-9b5a-74908ee7d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.540442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.540739 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.541016 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.559492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-cf44ab8f-e234-4e04-9b5a-74908ee7d864 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:10.561307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cf44ab8f-e234-4e04-9b5a-74908ee7d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.576602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] MFA Rules not processed for user `3f49deb14e7e47d2a0d52e6d3dcb264e`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:10.578024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.647749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1293/2590] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:10.655587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.655945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.656297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.663300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1298/2591] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:10.678014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.679682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.690866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:10.695668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:10.697353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.706758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1294/2592] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:10.712105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.724600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03079a33-e38a-4e0a-aa1b-dc585a9cf2dc None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.732108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.732789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.733112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.733375 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.738101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:10.740105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.747531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.775416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1295/2593] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:56:10.777409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.778758 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a251c6e-f2c7-4ec3-b573-af6cfd4306cd None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.783280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.790987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.790987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.790987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.791918 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e3c6f-a45c-4094-84ff-ba431ce0a24d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.796064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.797646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.798173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.798893 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.799239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.799467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.800173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.802738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.809001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1299/2594] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:56:10.829933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.831520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:10.849389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f0c3-15d4-4b5b-85ac-6b87725e8252 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.851807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.853126 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.853460 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.853878 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] PATH_INFO: `/v3/users/3f49deb14e7e47d2a0d52e6d3dcb264e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.855745 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f49deb14e7e47d2a0d52e6d3dcb264e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.859964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:10.898062 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1296/2595] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:10 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:10.902329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:10.965817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4f867-a969-4f6b-bcf7-cdf85a529f92 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:10.970384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:10.971138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:10.971420 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:10.971700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:10.972391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:10.974993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:11.105798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1297/2596] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:10 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:56:11.115163 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:11.117696 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f49deb14e7e47d2a0d52e6d3dcb264e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:11.125710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f49deb14e7e47d2a0d52e6d3dcb264e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:11.126063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f49deb14e7e47d2a0d52e6d3dcb264e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:11.126800 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f49deb14e7e47d2a0d52e6d3dcb264e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:11.148263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f3489-5b36-4449-95a7-f37aaae408ff admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:11.156063 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:11.156924 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.157449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.157890 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.162709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:11.162992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba3c0b3f-786b-4df6-8e93-1b97959b8dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f49deb14e7e47d2a0d52e6d3dcb264e'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:11.163095 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:11.177381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1298/2597] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:11.178755 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:11.180929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:11.198187 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201a119-5f7f-47e7-8f5c-33446a7e3d42 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:11.203339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:11.204154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.204549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.204871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.205701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:11.207453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:11.218721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1299/2598] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:11.223963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:11.226036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:11.236184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e31dbf-7a60-4d20-acc9-c70d3dbed5b2 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:11.242121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ccf3a-232d-4ed2-ae59-211f2ddee3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:11.243042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ccf3a-232d-4ed2-ae59-211f2ddee3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.243345 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ccf3a-232d-4ed2-ae59-211f2ddee3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.243608 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ccf3a-232d-4ed2-ae59-211f2ddee3f3 admin admin] PATH_INFO: `/v3/projects/3a6c1b2ca3de4e44955dd03ccea30427/users/ee17c214934b4c19b22571925692c051/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.258840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ccf3a-232d-4ed2-ae59-211f2ddee3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6c1b2ca3de4e44955dd03ccea30427, user_id=ee17c214934b4c19b22571925692c051, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:11.261618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ccf3a-232d-4ed2-ae59-211f2ddee3f3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:11.275539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1300/2599] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:10 2022] DELETE /identity/v3/users/3f49deb14e7e47d2a0d52e6d3dcb264e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:56:11.276700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.276991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.277313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.294585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:11.295820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:11.358518 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1301/2600] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:11.368822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:11.370230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:11.401208 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1300/2601] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:11 2022] PUT /identity/v3/projects/3a6c1b2ca3de4e44955dd03ccea30427/users/ee17c214934b4c19b22571925692c051/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:11.412034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.412324 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.412609 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.434119 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a1a4c-2e02-45e7-92ec-ae039f4ef4c5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:11.438995 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] MFA Rules not processed for user `ee17c214934b4c19b22571925692c051`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:11.439871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:11.485017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:11.485754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.486041 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.486322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.507396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1301/2602] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:11.521056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:11.522310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:11.559885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:11.561404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:11.572685 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1302/2603] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:56:11.604527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d825-9c0a-4d21-a47e-fd34124d45a5 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:11.610834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11674e25-6103-48c7-9d41-8831654b1085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:11.611435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674e25-6103-48c7-9d41-8831654b1085 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:11.611733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674e25-6103-48c7-9d41-8831654b1085 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:11.612021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674e25-6103-48c7-9d41-8831654b1085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:11.621308 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11674e25-6103-48c7-9d41-8831654b1085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:11.623091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11674e25-6103-48c7-9d41-8831654b1085 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:11.633894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1302/2604] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:56:11.697637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:11.790235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:12.008214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.009786 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:12.024406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfb7d7-e5f7-471f-a0f5-7d15725be007 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.031989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.032231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.032556 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.032730 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] PATH_INFO: `/v3/projects/87dd6fc4788645028e6847a1d0d1badd` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.034170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87dd6fc4788645028e6847a1d0d1badd)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.036571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:12.189538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87dd6fc4788645028e6847a1d0d1badd', 'request_id': 'req-09517dec-09ba-456d-bb47-dcaed8edee12'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:12.196538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87dd6fc4788645028e6847a1d0d1badd', 'request_id': 'req-09517dec-09ba-456d-bb47-dcaed8edee12'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:12.203694 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87dd6fc4788645028e6847a1d0d1badd', 'request_id': 'req-09517dec-09ba-456d-bb47-dcaed8edee12'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:12.277774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] The token cache is being invalidate because project 87dd6fc4788645028e6847a1d0d1badd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:12.281008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:12.281008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-09517dec-09ba-456d-bb47-dcaed8edee12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:12.281916 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1303/2605] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:12 2022] DELETE /identity/v3/projects/87dd6fc4788645028e6847a1d0d1badd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:12.298923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.299219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.299507 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.318687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:12.319903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:12.355385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:12.382913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1303/2606] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:12.390632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.391629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.392374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.421507 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:12.422712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:12.431250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1304/2607] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:12.435936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.450936 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b352b1-397d-4b4f-9da6-2dc21d719f4a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.458319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.461440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.461440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.461440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.461440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:12.461440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.462219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:12.479696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1304/2608] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:56:12.481145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.491784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b0c5-69ed-468a-a1d6-649d4e52e96d None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.498923 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.500397 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.500515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.500876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.501700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.507340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:12.643442 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1305/2609] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:12 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:12.648317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.657724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:12.661952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e96df6-7246-495e-82c3-7d9ed0e19dfb admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.719485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.720079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.720371 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.720656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.721381 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.723869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:12.824443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1305/2610] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:12 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:12.828454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.838969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3261-a656-4364-8588-411f6d6b7b15 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.843623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.844282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.844602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.844957 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.845732 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.847321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:12.858578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1306/2611] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:12.866486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.876724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370046-c056-4ed7-a043-e7cc5b4c5fbb admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.882984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706f3f-cdff-44b8-9a93-db60d1cf82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.883662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706f3f-cdff-44b8-9a93-db60d1cf82c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.883947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706f3f-cdff-44b8-9a93-db60d1cf82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.884227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706f3f-cdff-44b8-9a93-db60d1cf82c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.885134 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706f3f-cdff-44b8-9a93-db60d1cf82c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.886966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706f3f-cdff-44b8-9a93-db60d1cf82c2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:12.898189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1306/2612] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:12.905760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:12.916374 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6ac7a-ab34-4d7d-b599-fa3ad527467a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:12.921172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:12.922092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:12.922381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:12.922667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] PATH_INFO: `/v3/projects/c7bfc0bf30a64c10ac10270fa96ef591/users/0c920fcdab46450bb0ad0370a1cc343f/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:12.938007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bfc0bf30a64c10ac10270fa96ef591, user_id=0c920fcdab46450bb0ad0370a1cc343f, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:12.940664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:13.024023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1307/2613] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:12 2022] PUT /identity/v3/projects/c7bfc0bf30a64c10ac10270fa96ef591/users/0c920fcdab46450bb0ad0370a1cc343f/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:13.035789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab53ad-4ae5-4066-aec8-3fc184ee9b40 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:13.036083 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab53ad-4ae5-4066-aec8-3fc184ee9b40 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:13.036370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab53ad-4ae5-4066-aec8-3fc184ee9b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:13.064962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-01ab53ad-4ae5-4066-aec8-3fc184ee9b40 None None] MFA Rules not processed for user `0c920fcdab46450bb0ad0370a1cc343f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:13.066304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-01ab53ad-4ae5-4066-aec8-3fc184ee9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:13.132639 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1307/2614] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:13.143364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:13.145691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:13.203949 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36becb37-ca53-4a37-862a-f92c0e5831b4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:13.208530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:13.209195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:13.209512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:13.209798 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:13.219455 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:13.221736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:13.230723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1308/2615] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:18.300628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cef92-59f5-439c-a367-9c82a0e74da8 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:18.301709 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cef92-59f5-439c-a367-9c82a0e74da8 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:18.301818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cef92-59f5-439c-a367-9c82a0e74da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:18.320244 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f08cef92-59f5-439c-a367-9c82a0e74da8 None None] MFA Rules not processed for user `0c920fcdab46450bb0ad0370a1cc343f`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:18.321501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f08cef92-59f5-439c-a367-9c82a0e74da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:18.328737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1308/2616] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:21.068535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:21.068535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:21.089124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:21.135749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb9812-eb26-49a8-90e2-3b0e18c9bd62 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:21.140814 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:21.141882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:21.142094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:21.142400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] PATH_INFO: `/v3/users/ee17c214934b4c19b22571925692c051` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:21.143574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee17c214934b4c19b22571925692c051)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:21.146371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:21.383024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee17c214934b4c19b22571925692c051'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:21.391597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee17c214934b4c19b22571925692c051'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:21.392337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee17c214934b4c19b22571925692c051'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:21.392965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee17c214934b4c19b22571925692c051'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:21.411220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee17c214934b4c19b22571925692c051'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:21.584336 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1309/2617] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:21 2022] DELETE /identity/v3/users/ee17c214934b4c19b22571925692c051 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:21.589044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:21.589942 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:21.590233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:21.610430 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:21.611668 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:21.678433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1309/2618] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:21.690660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:21.694584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:21.768095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b868a-6580-416f-abc0-46c89d789b0c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:21.772564 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03060ffa-f771-4dd5-9a11-7ece8a452c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:21.773222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060ffa-f771-4dd5-9a11-7ece8a452c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:21.773541 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060ffa-f771-4dd5-9a11-7ece8a452c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:21.773826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060ffa-f771-4dd5-9a11-7ece8a452c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:21.783350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03060ffa-f771-4dd5-9a11-7ece8a452c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:21.784804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03060ffa-f771-4dd5-9a11-7ece8a452c54 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:21.795740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1310/2619] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:22.322678 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:22.324173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:22.337307 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9583e63-bf75-4463-9aee-8ee6e9d98558 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:22.342217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:22.343098 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:22.343389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:22.343673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] PATH_INFO: `/v3/projects/3a6c1b2ca3de4e44955dd03ccea30427` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:22.344875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6c1b2ca3de4e44955dd03ccea30427)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:22.346997 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:22.352317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:22.500691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6c1b2ca3de4e44955dd03ccea30427', 'request_id': 'req-caf980c7-417d-4abe-a4f0-851692178a2e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:22.577819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6c1b2ca3de4e44955dd03ccea30427', 'request_id': 'req-caf980c7-417d-4abe-a4f0-851692178a2e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:22.584791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6c1b2ca3de4e44955dd03ccea30427', 'request_id': 'req-caf980c7-417d-4abe-a4f0-851692178a2e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:22.596390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] The token cache is being invalidate because project 3a6c1b2ca3de4e44955dd03ccea30427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:22.597007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:22.597554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-caf980c7-417d-4abe-a4f0-851692178a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:22.599744 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1310/2620] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:22 2022] DELETE /identity/v3/projects/3a6c1b2ca3de4e44955dd03ccea30427 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:22.604620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d9155-01cd-4878-8088-d808488aef42 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:22.605411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d9155-01cd-4878-8088-d808488aef42 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:22.605581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d9155-01cd-4878-8088-d808488aef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:22.624834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-159d9155-01cd-4878-8088-d808488aef42 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:22.627566 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-159d9155-01cd-4878-8088-d808488aef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:22.687250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:22.719603 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1311/2621] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:22.721569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:22.725005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:22.725005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:22.742986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:22.744236 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:22.756646 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1311/2622] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:22.760444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d9155-01cd-4878-8088-d808488aef42 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:22.771805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d9155-01cd-4878-8088-d808488aef42 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:22.776688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:22.777407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:22.777704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:22.777992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:22.778735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:22.779052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:22.780988 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:22.794972 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1312/2623] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:56:22.800200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:22.810560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732368d-0a29-4a8f-9cb1-1be74ab10d34 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:22.815540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:22.820854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:22.820854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:22.820854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:22.820854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:22.820854 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:22.964021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1312/2624] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:22 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:22.967805 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:22.984293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c945-d032-4983-9c1b-94de48d2e683 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.060626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.060626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.060626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.060626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.061061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.061061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.164708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1313/2625] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:22 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:23.168977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.181962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f271b-64cf-4d4f-80ed-3996a1588c6f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.187305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.188218 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.188514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.188972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.190339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.193265 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.213106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1313/2626] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:23.216021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.227944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce1f1-4090-4390-b5f1-694c7fb69fae admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.233091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724238-551e-4d29-a3a4-7a13f7b58109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.233830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724238-551e-4d29-a3a4-7a13f7b58109 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.234129 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724238-551e-4d29-a3a4-7a13f7b58109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.234398 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724238-551e-4d29-a3a4-7a13f7b58109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.235136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724238-551e-4d29-a3a4-7a13f7b58109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.236756 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724238-551e-4d29-a3a4-7a13f7b58109 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.249328 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1314/2627] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:56:23.253426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.275727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626149f9-fc74-46a4-b320-fa2fb48634d9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.280780 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.281794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.282409 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.282896 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] PATH_INFO: `/v3/projects/acf13b34bb5e4cb1949e256647aac7b0/users/92f583b55ed94efeacbe5516836321c3/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.306255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf13b34bb5e4cb1949e256647aac7b0, user_id=92f583b55ed94efeacbe5516836321c3, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.309266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.385061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1314/2628] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:23 2022] PUT /identity/v3/projects/acf13b34bb5e4cb1949e256647aac7b0/users/92f583b55ed94efeacbe5516836321c3/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:23.397559 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.397802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.397990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.427314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] MFA Rules not processed for user `92f583b55ed94efeacbe5516836321c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:23.428064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:23.501663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1315/2629] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:23.509005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.602541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551adfa5-cc20-4a44-a483-2704c64bd72b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.608821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.609742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.610110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.610312 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.611031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.613028 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.737366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1315/2630] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:23 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:23.740258 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.751845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b89dd-32bd-4d89-8e0a-aba4bc30ccf1 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.788632 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:23.816058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.817540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.817844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.818121 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.818832 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.820794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.938979 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1316/2631] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:23 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:23.944133 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.955291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9e435-78dc-41c8-8bf3-2aee96d2e969 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:23.960939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:23.961659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:23.961987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:23.962269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:23.963014 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:23.964635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:23.970443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:23.977943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1316/2632] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:23.982069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:23.994304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0024a-e9a1-4573-8138-3e68c59eea6b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:24.001315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:24.002199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:24.002489 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:24.002774 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] PATH_INFO: `/v3/projects/3710cf47e61642749c7578b14d76471e/users/32a18e0c7f8840a588507217da6c1c85/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:24.018978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710cf47e61642749c7578b14d76471e, user_id=32a18e0c7f8840a588507217da6c1c85, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:24.022002 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:24.158825 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1317/2633] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:23 2022] PUT /identity/v3/projects/3710cf47e61642749c7578b14d76471e/users/32a18e0c7f8840a588507217da6c1c85/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:24.166118 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:24.179328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f258c-2e26-4082-9bf0-d15851b07187 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:24.296110 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a87d-90f5-43d4-bd7d-a0352569ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:24.297258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a87d-90f5-43d4-bd7d-a0352569ec4f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:24.297739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a87d-90f5-43d4-bd7d-a0352569ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:24.298180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a87d-90f5-43d4-bd7d-a0352569ec4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:24.299269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a87d-90f5-43d4-bd7d-a0352569ec4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:24.301633 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a87d-90f5-43d4-bd7d-a0352569ec4f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:24.317411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1317/2634] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:56:24.327752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:24.340760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0598b6-a083-4da4-8ffc-10c7c174c124 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:24.347178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:24.349318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:24.349318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:24.349534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] PATH_INFO: `/v3/projects/3710cf47e61642749c7578b14d76471e/users/32a18e0c7f8840a588507217da6c1c85/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:24.351483 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710cf47e61642749c7578b14d76471e, user_id=32a18e0c7f8840a588507217da6c1c85, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:24.354415 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:24.366683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1318/2635] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:24 2022] PUT /identity/v3/projects/3710cf47e61642749c7578b14d76471e/users/32a18e0c7f8840a588507217da6c1c85/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:24.376842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:24.377156 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:24.377453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:24.406164 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] MFA Rules not processed for user `32a18e0c7f8840a588507217da6c1c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:24.407389 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:24.505625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1318/2636] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:24.510938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:24.513299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:24.583082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a399366-985a-444c-962a-9bdf58442a6c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:24.587124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee323f2-5362-4c2e-adf4-93a0d9a3a7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:24.587781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee323f2-5362-4c2e-adf4-93a0d9a3a7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:24.588607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee323f2-5362-4c2e-adf4-93a0d9a3a7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:24.588607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee323f2-5362-4c2e-adf4-93a0d9a3a7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:24.600017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee323f2-5362-4c2e-adf4-93a0d9a3a7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:24.601511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee323f2-5362-4c2e-adf4-93a0d9a3a7e2 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:24.637820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1319/2637] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:24 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:25.670021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:25.757843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896e3f-5690-411f-9470-83e1ae6c8ec0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:25.760153 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:25.761046 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:25.761397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:25.761712 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] PATH_INFO: `/v3/users/92f583b55ed94efeacbe5516836321c3` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:25.762945 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f583b55ed94efeacbe5516836321c3)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:25.764923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:25.790597 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:26.003978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f583b55ed94efeacbe5516836321c3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:26.011960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f583b55ed94efeacbe5516836321c3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:26.012701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f583b55ed94efeacbe5516836321c3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:26.013372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f583b55ed94efeacbe5516836321c3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:26.109782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f583b55ed94efeacbe5516836321c3'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:26.128696 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1319/2638] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:25 2022] DELETE /identity/v3/users/92f583b55ed94efeacbe5516836321c3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:26.134269 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:26.134794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:26.134991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:26.154386 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:26.155624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:26.224642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1320/2639] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:26.237551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:26.241543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:26.306530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2250eb-c925-4178-b371-b0610929da81 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:26.310253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:26.310790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:26.311075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:26.311359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:26.322751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:26.324178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:26.335807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1320/2640] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:26.923710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:26.925250 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:26.937963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883a4a-8b30-468c-80a4-34275b84b3db None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:26.943645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:26.944508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:26.944796 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:26.945080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] PATH_INFO: `/v3/projects/acf13b34bb5e4cb1949e256647aac7b0` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:26.946312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf13b34bb5e4cb1949e256647aac7b0)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:26.948228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:27.062226 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:27.079801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf13b34bb5e4cb1949e256647aac7b0', 'request_id': 'req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.086628 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf13b34bb5e4cb1949e256647aac7b0', 'request_id': 'req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.094401 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf13b34bb5e4cb1949e256647aac7b0', 'request_id': 'req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.200922 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] The token cache is being invalidate because project acf13b34bb5e4cb1949e256647aac7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:27.201991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.203310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.205172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1321/2641] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:26 2022] DELETE /identity/v3/projects/acf13b34bb5e4cb1949e256647aac7b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:27.209323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:27.220055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818d83-8aae-4e19-9c64-72d1d9999f74 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:27.295326 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:27.296223 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:27.296515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:27.296801 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] PATH_INFO: `/v3/users/32a18e0c7f8840a588507217da6c1c85` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:27.298033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a18e0c7f8840a588507217da6c1c85)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:27.301634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:27.463677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:27.465682 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a18e0c7f8840a588507217da6c1c85'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.475615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a18e0c7f8840a588507217da6c1c85'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.476362 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a18e0c7f8840a588507217da6c1c85'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.477234 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a18e0c7f8840a588507217da6c1c85'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.549674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-003e5751-51bc-4b68-a795-f54a488ca999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a18e0c7f8840a588507217da6c1c85'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:27.573902 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1321/2642] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:27 2022] DELETE /identity/v3/users/32a18e0c7f8840a588507217da6c1c85 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:28.020773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.023822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:28.038194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5c3bc-322d-40b4-a8ed-3afb7774ee5a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.100995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.101938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.102233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.102555 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] PATH_INFO: `/v3/projects/3710cf47e61642749c7578b14d76471e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.103785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3710cf47e61642749c7578b14d76471e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:28.105799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:28.273654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3710cf47e61642749c7578b14d76471e', 'request_id': 'req-d837e680-1eb7-436f-aab3-ae271de2fa78'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:28.280313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3710cf47e61642749c7578b14d76471e', 'request_id': 'req-d837e680-1eb7-436f-aab3-ae271de2fa78'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:28.286920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3710cf47e61642749c7578b14d76471e', 'request_id': 'req-d837e680-1eb7-436f-aab3-ae271de2fa78'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:28.421450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] The token cache is being invalidate because project 3710cf47e61642749c7578b14d76471e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:28.421765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:28.422367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-d837e680-1eb7-436f-aab3-ae271de2fa78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:28.423930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1322/2643] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:28 2022] DELETE /identity/v3/projects/3710cf47e61642749c7578b14d76471e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:28.428971 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.429466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.429566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.448466 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:28.449732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:28.509117 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1322/2644] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:28.517714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.518008 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.518294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.541178 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:28.542420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:28.551039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1323/2645] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:28.555955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.566319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaca45a-ec48-44f2-b093-1b8b1224945f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.571761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.572467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.572759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.573048 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.573844 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:28.574162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:28.575815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:28.590662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1323/2646] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:56:28.595046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.604808 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed424414-1a62-4776-b2ec-c2947db8d592 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.609604 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.610276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.610562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.610953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.611646 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:28.613630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:28.704203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1324/2647] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:28 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:28.709021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.721321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41dd74-419c-4e07-9e88-51f6d1985a94 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.787064 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.787751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.788036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.788336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.789015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:28.791015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:28.891983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1324/2648] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:28 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:28.899672 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.912171 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a66b40-2f13-4417-95f7-7b17ff9e9ac0 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.917416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.917936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.918224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.918504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.919261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:28.920980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:28.934297 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1325/2649] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:28.938434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.949662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c4950-8542-4c96-870e-b800fa932fd1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.954505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d715ad-0485-46fd-a552-75eb573261f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.955182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d715ad-0485-46fd-a552-75eb573261f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.955470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d715ad-0485-46fd-a552-75eb573261f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.955752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d715ad-0485-46fd-a552-75eb573261f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.956489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d715ad-0485-46fd-a552-75eb573261f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:28.958694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d715ad-0485-46fd-a552-75eb573261f3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:28.969869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1325/2650] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:56:28.974159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:28.985001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1b8b-4851-4e4c-aa0d-fb54326b1218 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:28.991244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:28.992183 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:28.992520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:28.992788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] PATH_INFO: `/v3/projects/925f37e212a04ec5b2e109f2b06e884f/users/228615f3f2234d5d948692aaba55060b/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:28.995228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:29.009402 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925f37e212a04ec5b2e109f2b06e884f, user_id=228615f3f2234d5d948692aaba55060b, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.012096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.093170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1326/2651] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:28 2022] PUT /identity/v3/projects/925f37e212a04ec5b2e109f2b06e884f/users/228615f3f2234d5d948692aaba55060b/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:29.104849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.105140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.105463 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.134828 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] MFA Rules not processed for user `228615f3f2234d5d948692aaba55060b`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:29.136259 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:29.155171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:29.206512 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1326/2652] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:29.211239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.276785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b231-d548-4c49-be05-c4d9a538b732 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:29.281724 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:29.282387 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.282809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.283066 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.283773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.286334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.369674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1327/2653] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:29 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:29.373888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.385580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb7123-23cf-4f13-af72-75a152312e64 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:29.444217 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:29.444958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.445953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.446391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.446972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.448909 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.539167 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1327/2654] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:29 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:56:29.543429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.555359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba183970-24a2-4950-9893-9a252532005f admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:29.560131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:29.560799 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.561087 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.561412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.562142 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.563809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.575292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1328/2655] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:29.579781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.590839 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80acf-e77e-4d8b-b930-aee7f8970945 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:29.595588 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:29.596474 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.596758 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.597041 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] PATH_INFO: `/v3/projects/979deae686314668baeb1b74c62c7d3b/users/70382425f67c4917bf67a88f7230a839/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.612711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979deae686314668baeb1b74c62c7d3b, user_id=70382425f67c4917bf67a88f7230a839, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.615587 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.721377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1328/2656] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:29 2022] PUT /identity/v3/projects/979deae686314668baeb1b74c62c7d3b/users/70382425f67c4917bf67a88f7230a839/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:29.725933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.736033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a48e-6cb3-4148-8969-f231e55e7f1e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:29.793524 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78671ea4-3763-4a4b-adf2-d5e3cebc577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:29.794088 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671ea4-3763-4a4b-adf2-d5e3cebc577a admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.794371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671ea4-3763-4a4b-adf2-d5e3cebc577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.794651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671ea4-3763-4a4b-adf2-d5e3cebc577a admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.795372 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671ea4-3763-4a4b-adf2-d5e3cebc577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.796974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671ea4-3763-4a4b-adf2-d5e3cebc577a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.807221 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1329/2657] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:56:29.811578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.823460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d57de-9165-4477-994b-03c97d5cf941 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:29.828081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:29.828998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.829296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.829605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] PATH_INFO: `/v3/projects/979deae686314668baeb1b74c62c7d3b/users/70382425f67c4917bf67a88f7230a839/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.831583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=979deae686314668baeb1b74c62c7d3b, user_id=70382425f67c4917bf67a88f7230a839, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:29.835033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:29.845552 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1329/2658] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:29 2022] PUT /identity/v3/projects/979deae686314668baeb1b74c62c7d3b/users/70382425f67c4917bf67a88f7230a839/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:29.856517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:29.856944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:29.857638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:29.885084 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] MFA Rules not processed for user `70382425f67c4917bf67a88f7230a839`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:29.886329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:29.930113 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:29.960112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1330/2659] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:29.969900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:29.971654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:30.034439 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254fd3-fd67-47f6-9c73-63fad950df3b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:30.038677 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:30.039440 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:30.039795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:30.040144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:30.065794 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:30.102731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:30.104184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:30.114032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1330/2660] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:36.773815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:36.775330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:36.787593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba0e3c-059d-4ccb-b89e-e71f4cbbf997 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:36.791125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf950a3-ccec-40c1-9425-6447fa4fdfce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:36.791765 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf950a3-ccec-40c1-9425-6447fa4fdfce service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:36.792052 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf950a3-ccec-40c1-9425-6447fa4fdfce service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:36.792344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf950a3-ccec-40c1-9425-6447fa4fdfce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:36.802726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf950a3-ccec-40c1-9425-6447fa4fdfce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:36.804535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf950a3-ccec-40c1-9425-6447fa4fdfce service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:36.815448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1331/2661] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:40.709247 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=16 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:42.953849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:42.955340 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:43.025797 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98242705-1598-4506-8fbd-6381f64f5952 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:43.030889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48914429-28bc-440d-9330-faf07a5247de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:43.034693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48914429-28bc-440d-9330-faf07a5247de service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:43.034693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48914429-28bc-440d-9330-faf07a5247de service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:43.034693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48914429-28bc-440d-9330-faf07a5247de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:43.034693 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-48914429-28bc-440d-9330-faf07a5247de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:43.045793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48914429-28bc-440d-9330-faf07a5247de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:43.047384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48914429-28bc-440d-9330-faf07a5247de service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:43.058498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1331/2662] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:46.091910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756438-b9a2-4af0-af02-35f4698a0dcf None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:46.092396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756438-b9a2-4af0-af02-35f4698a0dcf None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:46.092817 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756438-b9a2-4af0-af02-35f4698a0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:46.111070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-84756438-b9a2-4af0-af02-35f4698a0dcf None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:46.112317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-84756438-b9a2-4af0-af02-35f4698a0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:46.169394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1332/2663] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:56:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:46.461752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48914429-28bc-440d-9330-faf07a5247de service placement] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:46.463239 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-48914429-28bc-440d-9330-faf07a5247de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:46.533791 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48914429-28bc-440d-9330-faf07a5247de service placement] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:46.539599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:46.540255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:46.540541 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:46.540823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:46.549065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:46.558684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:46.559578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1332/2664] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:56:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:47.492466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55bb7-001c-4682-bf73-95c792bf227c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:47.492946 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55bb7-001c-4682-bf73-95c792bf227c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:47.493042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55bb7-001c-4682-bf73-95c792bf227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:47.511794 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5ae55bb7-001c-4682-bf73-95c792bf227c None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:47.513042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5ae55bb7-001c-4682-bf73-95c792bf227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:47.520896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1333/2665] 10.222.0.70 () {58 vars in 967 bytes} [Tue Jun 21 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:47.533717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:47.545506 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dcf99-fc0c-4da0-9b0c-26934968bd8c service swift] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:47.550537 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:47.551176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:47.551470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:47.552487 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:47.560841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:47.562451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:47.571891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1333/2666] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:56:48.218014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f493f6c-389f-41c9-8b47-919945629cf7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:48.218304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f493f6c-389f-41c9-8b47-919945629cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:48.218583 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f493f6c-389f-41c9-8b47-919945629cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:48.237199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-5f493f6c-389f-41c9-8b47-919945629cf7 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:48.238428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5f493f6c-389f-41c9-8b47-919945629cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:48.247288 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1334/2667] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:48.259804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:48.274368 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9f5ab-4055-4591-a6b3-922a30d693c5 service swift] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:48.279561 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:48.280201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:48.280492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:48.280898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:48.421906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:48.421906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:48.421906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1334/2668] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:49.072330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:49.072850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:49.073062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:49.103574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:49.103574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:49.103574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1335/2669] 10.222.0.70 () {58 vars in 967 bytes} [Tue Jun 21 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:56:49.113810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:49.125547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1f35-3e87-42a1-9dc7-aaf8bbca6f60 service swift] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:49.137916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964d0d8-86c9-4431-b8b1-8b2229c08158 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:49.137916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964d0d8-86c9-4431-b8b1-8b2229c08158 service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:49.137916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964d0d8-86c9-4431-b8b1-8b2229c08158 service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:49.137916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964d0d8-86c9-4431-b8b1-8b2229c08158 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:49.140603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964d0d8-86c9-4431-b8b1-8b2229c08158 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:49.142269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964d0d8-86c9-4431-b8b1-8b2229c08158 service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:49.154255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1335/2670] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 16:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:54.058795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:54.060335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:54.144759 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c9196-49a5-464a-94e5-117ed7800ee5 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:54.153861 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:54.156028 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:54.156715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:54.157206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] PATH_INFO: `/v3/users/0c920fcdab46450bb0ad0370a1cc343f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:54.159344 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c920fcdab46450bb0ad0370a1cc343f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:54.163613 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:54.386642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c920fcdab46450bb0ad0370a1cc343f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:54.391533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:54.394480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c920fcdab46450bb0ad0370a1cc343f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:54.395165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c920fcdab46450bb0ad0370a1cc343f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:54.395829 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c920fcdab46450bb0ad0370a1cc343f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:54.408488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c920fcdab46450bb0ad0370a1cc343f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:54.575131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1336/2671] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:56:54 2022] DELETE /identity/v3/users/0c920fcdab46450bb0ad0370a1cc343f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:54.579706 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:54.580246 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:54.580357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:54.604627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:54.606284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:54.641705 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:54.673094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1336/2672] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:54.683427 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:54.684941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:54.747010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e693-b50a-40c5-badc-ee0ea87706cf admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:54.750741 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c39e26-5533-4d9d-8e50-0fa0453c40ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:54.751400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39e26-5533-4d9d-8e50-0fa0453c40ab service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:54.751690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39e26-5533-4d9d-8e50-0fa0453c40ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:54.751976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39e26-5533-4d9d-8e50-0fa0453c40ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:54.762070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c39e26-5533-4d9d-8e50-0fa0453c40ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:54.763522 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c39e26-5533-4d9d-8e50-0fa0453c40ab service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:54.773687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1337/2673] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:55.060333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:55.062428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:55.078958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1991f-6d30-4d08-8b14-ff841cedcb42 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:55.086998 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:55.088477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:55.088976 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:55.089519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] PATH_INFO: `/v3/projects/c7bfc0bf30a64c10ac10270fa96ef591` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:55.091719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bfc0bf30a64c10ac10270fa96ef591)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:55.095441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:55.308804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bfc0bf30a64c10ac10270fa96ef591', 'request_id': 'req-9a217969-bad6-451d-997c-12a0d63f2e14'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:55.440510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bfc0bf30a64c10ac10270fa96ef591', 'request_id': 'req-9a217969-bad6-451d-997c-12a0d63f2e14'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:55.447707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bfc0bf30a64c10ac10270fa96ef591', 'request_id': 'req-9a217969-bad6-451d-997c-12a0d63f2e14'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:55.458560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] The token cache is being invalidate because project c7bfc0bf30a64c10ac10270fa96ef591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:56:55.458882 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:55.460576 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9a217969-bad6-451d-997c-12a0d63f2e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:56:55.462151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1337/2674] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:56:55 2022] DELETE /identity/v3/projects/c7bfc0bf30a64c10ac10270fa96ef591 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:55.467072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:55.467572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:55.467680 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:55.487299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:55.488528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:55.552779 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1338/2675] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:55.560951 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:55.570974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:55.570974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:55.580494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:55.581739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:55.590619 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1338/2676] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:55.595246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:55.605510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f06c1c-0878-4ff1-8bd6-7fcd0798ebca None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:55.610358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:55.611014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:55.611302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:55.611586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:55.612324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:56:55.612638 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:55.614292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:55.626585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1339/2677] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:56:55.631698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:55.641045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc265-666c-438e-a758-c23d06a9f3b0 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:55.645759 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:55.646495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:55.647433 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:55.647757 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:55.648464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:55.651319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:55.750357 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1339/2678] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:56:55 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:56:55.754515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:55.765841 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7acf-9d6b-4976-afe3-68d7d81cd7ea admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:55.826314 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:55.826937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:55.827229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:55.827510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:55.828361 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:55.830377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:55.837215 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:55.982445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1340/2679] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:56:55 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:56:55.986415 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:55.997834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023adf2-525c-46c8-a0a3-c15561ccd9c5 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:56.003414 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:56.004510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:56.004799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:56.005442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:56.007391 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:56.008982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:56.019790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1340/2680] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:56.023955 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:56.034546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4bbe9-817a-4951-825c-edec73ebf884 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:56.039299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d89b98-9a80-4cf1-8cc3-0f5bec8ea212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:56.039960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d89b98-9a80-4cf1-8cc3-0f5bec8ea212 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:56.040253 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d89b98-9a80-4cf1-8cc3-0f5bec8ea212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:56.040535 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d89b98-9a80-4cf1-8cc3-0f5bec8ea212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:56.041262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d89b98-9a80-4cf1-8cc3-0f5bec8ea212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:56.042893 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d89b98-9a80-4cf1-8cc3-0f5bec8ea212 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:56.054086 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1341/2681] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:56:56.058460 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:56.070010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065307e-717f-4118-891d-cfdafb26e5ea admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:56.074742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:56.075616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:56.075900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:56.076178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] PATH_INFO: `/v3/projects/7dddfcc30ee8433c9f48d7153b416f21/users/dfc90b18a1f44d1eb1bba4e64fa1d3a1/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:56.091595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dddfcc30ee8433c9f48d7153b416f21, user_id=dfc90b18a1f44d1eb1bba4e64fa1d3a1, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:56.094300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:56.176311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1341/2682] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:56:56 2022] PUT /identity/v3/projects/7dddfcc30ee8433c9f48d7153b416f21/users/dfc90b18a1f44d1eb1bba4e64fa1d3a1/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:56:56.182207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040322-05c2-4503-a18e-0e0eae643599 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:56.182497 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040322-05c2-4503-a18e-0e0eae643599 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:56.182778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040322-05c2-4503-a18e-0e0eae643599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:56.200773 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-67040322-05c2-4503-a18e-0e0eae643599 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:56.202036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-67040322-05c2-4503-a18e-0e0eae643599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:56.261933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1342/2683] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:56.272470 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:56.273572 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:56.336310 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399634-ec4b-402e-8c67-3c80cc2bf7cd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:56.340116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:56.340770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:56.341061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:56.341383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:56.351168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:56.352651 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:56.362123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1342/2684] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:56:57.681571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bafdd-1880-448e-b1cf-0dc9899b9546 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:57.682074 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bafdd-1880-448e-b1cf-0dc9899b9546 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:57.682198 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bafdd-1880-448e-b1cf-0dc9899b9546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:57.711176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-be5bafdd-1880-448e-b1cf-0dc9899b9546 None None] MFA Rules not processed for user `dfc90b18a1f44d1eb1bba4e64fa1d3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:56:57.712414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-be5bafdd-1880-448e-b1cf-0dc9899b9546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:57.779809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1343/2685] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:56:57.791718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:56:57.793150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:56:57.798530 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:57.852173 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b94ca-b164-4c5c-882c-efabd8ea43d7 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:56:57.855944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:56:57.856594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:56:57.856884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:56:57.857165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:56:57.866508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:56:57.868031 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:56:57.877127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1343/2686] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:56:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:00.738261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:00.738850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:00.738850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:00.758834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] MFA Rules not processed for user `dfc90b18a1f44d1eb1bba4e64fa1d3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:00.760046 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:00.767211 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1344/2687] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:01.533858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:01.535934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:01.549691 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859f121-bd90-4582-b8b5-95646ee05f93 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:01.553937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:01.554600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:01.554888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:01.555166 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:01.556898 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:01.617937 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:01.619451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6893317-e6eb-4350-9888-932b69b8d746 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:01.628906 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1344/2688] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:57:04.661072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:04.661072 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:04.670496 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a22a-afa5-4b13-ba70-24bce4b9b80c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:04.676144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:04.676338 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:04.676612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:04.676896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] PATH_INFO: `/v3/users/228615f3f2234d5d948692aaba55060b` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:04.679124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] RBAC: Authorizing `identity:delete_user(user_id=228615f3f2234d5d948692aaba55060b)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:04.680660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:04.911752 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228615f3f2234d5d948692aaba55060b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:04.919520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228615f3f2234d5d948692aaba55060b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:04.920186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228615f3f2234d5d948692aaba55060b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:04.920802 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228615f3f2234d5d948692aaba55060b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:04.922311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:04.934223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228615f3f2234d5d948692aaba55060b'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:05.075452 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1345/2689] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:04 2022] DELETE /identity/v3/users/228615f3f2234d5d948692aaba55060b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:05.080038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:05.080498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:05.080641 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:05.098799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:05.100673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:05.170005 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1345/2690] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:05.179767 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:05.181196 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:05.240200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5c9b3-90b7-4afe-b51d-bd8a5c8fccad admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:05.244053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:05.244698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:05.244985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:05.245268 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:05.254781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:05.257150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:05.266914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1346/2691] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:05.748322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:05.748322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:05.763138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be367b54-d1f3-49c9-b2a6-91c1066319c2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:05.768549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:05.769604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:05.769966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:05.770303 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] PATH_INFO: `/v3/projects/925f37e212a04ec5b2e109f2b06e884f` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:05.776807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=925f37e212a04ec5b2e109f2b06e884f)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:05.776807 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:05.918311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:05.926206 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925f37e212a04ec5b2e109f2b06e884f', 'request_id': 'req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.017426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925f37e212a04ec5b2e109f2b06e884f', 'request_id': 'req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.023743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925f37e212a04ec5b2e109f2b06e884f', 'request_id': 'req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.035214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] The token cache is being invalidate because project 925f37e212a04ec5b2e109f2b06e884f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:06.035467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.036204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.038851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1346/2692] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:05 2022] DELETE /identity/v3/projects/925f37e212a04ec5b2e109f2b06e884f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:06.042664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:06.055704 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071afd-3302-43a3-a35a-e9c16eae3939 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:06.131643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:06.133291 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:06.137642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:06.138006 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] PATH_INFO: `/v3/users/70382425f67c4917bf67a88f7230a839` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:06.139637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70382425f67c4917bf67a88f7230a839)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:06.142078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:06.594824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70382425f67c4917bf67a88f7230a839'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.604683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70382425f67c4917bf67a88f7230a839'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.605436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70382425f67c4917bf67a88f7230a839'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.606054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70382425f67c4917bf67a88f7230a839'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.619845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-51fa8864-ecd6-48df-afe4-f2a2b9d371d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70382425f67c4917bf67a88f7230a839'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:06.623839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:06.741663 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1347/2693] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:06 2022] DELETE /identity/v3/users/70382425f67c4917bf67a88f7230a839 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:07.259012 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:07.261180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:07.283034 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd70bf3-bcec-4d8d-8a7b-42ff083e17fb admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:07.342305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:07.343189 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:07.343479 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:07.343820 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] PATH_INFO: `/v3/projects/979deae686314668baeb1b74c62c7d3b` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:07.344978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979deae686314668baeb1b74c62c7d3b)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:07.347042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:07.480382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979deae686314668baeb1b74c62c7d3b', 'request_id': 'req-99d47e07-c0d7-4ec0-9c96-e391406bebb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:07.570612 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979deae686314668baeb1b74c62c7d3b', 'request_id': 'req-99d47e07-c0d7-4ec0-9c96-e391406bebb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:07.577579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979deae686314668baeb1b74c62c7d3b', 'request_id': 'req-99d47e07-c0d7-4ec0-9c96-e391406bebb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:07.589689 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] The token cache is being invalidate because project 979deae686314668baeb1b74c62c7d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:07.589963 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:07.590632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-99d47e07-c0d7-4ec0-9c96-e391406bebb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:07.592656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1347/2694] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:07 2022] DELETE /identity/v3/projects/979deae686314668baeb1b74c62c7d3b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:07.603024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:07.603024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:07.603024 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:07.628228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:07.629520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:07.706750 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1348/2695] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:07.716724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:07.717055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:07.717382 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:07.738813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:07.740857 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:07.749356 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1348/2696] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:07.754449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:07.766974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913842c4-c9d4-478a-b36a-e8ee6f836705 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:07.773069 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:07.774154 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:07.774254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:07.774447 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:07.775176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:57:07.775624 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:07.779537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:07.792713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1349/2697] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:57:07.798001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:07.810983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162281-e422-4955-aa99-b3c2a2718cda None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:07.815841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:07.816499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:07.816793 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:07.817081 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:07.817817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:07.819789 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:07.931008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1349/2698] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:57:07 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:57:07.932396 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:07.949070 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f98d9-488a-432f-ac55-4fdf0feec776 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.026733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.026733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.026733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.027042 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.027620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.029781 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.162152 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1350/2699] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:57:07 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:57:08.163402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:08.174237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980e098-bf1d-4238-90b9-3f423708a989 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.181336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.182109 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.182406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.182694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.183411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.185077 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.198517 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1350/2700] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:57:08.202852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:08.213714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0339e-6d24-4e21-bceb-b255756fd41a admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.218914 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a5fe-cadd-4e40-88ce-3796de38c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.219635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a5fe-cadd-4e40-88ce-3796de38c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.219859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a5fe-cadd-4e40-88ce-3796de38c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.220140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a5fe-cadd-4e40-88ce-3796de38c5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.220881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8a5fe-cadd-4e40-88ce-3796de38c5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.225318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8a5fe-cadd-4e40-88ce-3796de38c5f0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.241325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1351/2701] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:57:08.243101 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:08.254411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc927-6ef3-420b-a4fb-8318c8cfdb81 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.275564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.276184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.276184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.276359 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] PATH_INFO: `/v3/projects/561602c9078c4a23ac69dd7f03519c7e/users/56e3ab4354fc48d3bf4b231c7e6ab99b/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.295620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] RBAC: Authorizing `identity:create_grant(project_id=561602c9078c4a23ac69dd7f03519c7e, user_id=56e3ab4354fc48d3bf4b231c7e6ab99b, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.297486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.300035 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:08.412800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1351/2702] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:57:08 2022] PUT /identity/v3/projects/561602c9078c4a23ac69dd7f03519c7e/users/56e3ab4354fc48d3bf4b231c7e6ab99b/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:08.422935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.423232 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.423515 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.453987 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] MFA Rules not processed for user `56e3ab4354fc48d3bf4b231c7e6ab99b`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:08.455249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:08.510406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:08.528345 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1352/2703] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:08.532654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:08.617728 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b7eea-5d15-45a9-954f-bb57c2f9184d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.622509 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.623176 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.623465 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.623751 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.624480 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.626477 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.730684 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1352/2704] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:57:08 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:57:08.732891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:08.744687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23f205-a0ed-413e-a589-5efcd5a000b0 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.814487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.815248 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.815534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.815820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.816538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.819127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.944656 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1353/2705] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:57:08 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:57:08.948610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:08.959178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b63a-26f7-4fb8-a5bd-6eea9a743885 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:08.963861 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:08.964532 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:08.964843 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:08.965122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:08.965891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:08.967526 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:08.984666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1353/2706] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:57:08.989846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:09.001578 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443ae8-5879-4263-902c-c732c5ec2960 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:09.007443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:09.008364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.008648 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.008965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] PATH_INFO: `/v3/projects/74668246cac3483c8f7d603b4bff24fa/users/2c7d3ca18fd6455faed28e6618f261e8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.024697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74668246cac3483c8f7d603b4bff24fa, user_id=2c7d3ca18fd6455faed28e6618f261e8, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:09.028286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:09.108915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1354/2707] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:57:08 2022] PUT /identity/v3/projects/74668246cac3483c8f7d603b4bff24fa/users/2c7d3ca18fd6455faed28e6618f261e8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:57:09.113671 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:09.125566 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66c599-5d48-46f1-af25-0d4c0330e175 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:09.185620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dca0e6-1b0b-46ba-b568-2fc92993aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:09.186353 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dca0e6-1b0b-46ba-b568-2fc92993aa92 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.187105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dca0e6-1b0b-46ba-b568-2fc92993aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.187105 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dca0e6-1b0b-46ba-b568-2fc92993aa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.187666 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dca0e6-1b0b-46ba-b568-2fc92993aa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:09.189329 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dca0e6-1b0b-46ba-b568-2fc92993aa92 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:09.200263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1354/2708] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:57:09.204740 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:09.222636 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda7282-0429-4349-83e3-2fba26bcb67b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:09.228233 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:09.229212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.229532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.229839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] PATH_INFO: `/v3/projects/74668246cac3483c8f7d603b4bff24fa/users/2c7d3ca18fd6455faed28e6618f261e8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.232007 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74668246cac3483c8f7d603b4bff24fa, user_id=2c7d3ca18fd6455faed28e6618f261e8, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:09.234807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:09.257423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1355/2709] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:57:09 2022] PUT /identity/v3/projects/74668246cac3483c8f7d603b4bff24fa/users/2c7d3ca18fd6455faed28e6618f261e8/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:57:09.263467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.263762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.264044 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.298170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] MFA Rules not processed for user `2c7d3ca18fd6455faed28e6618f261e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:09.299402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:09.357929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:09.378180 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1355/2710] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:09.392165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:09.394308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:09.481641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41680-0e92-4ac3-b197-ba1f615bf5c4 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:09.486168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:09.486895 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.487201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.487530 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.499378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:09.502678 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:09.513176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1356/2711] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:09.537632 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:09.539065 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:09.598498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d70b0-4a3a-4f6a-b65a-86b8cdd8e28f None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:09.603030 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:09.606958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.606958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.606958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.606958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:09.677559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:09.679221 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:09.689591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1356/2712] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:09.781224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:09.790691 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9743e-9c61-462f-b80c-e0f5e64368c3 service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:09.794642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e956da7-25c6-4411-98bf-e58bc030ae4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:09.795394 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e956da7-25c6-4411-98bf-e58bc030ae4d service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:09.795686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e956da7-25c6-4411-98bf-e58bc030ae4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:09.795978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e956da7-25c6-4411-98bf-e58bc030ae4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:09.847249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:09.860257 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e956da7-25c6-4411-98bf-e58bc030ae4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:09.861815 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e956da7-25c6-4411-98bf-e58bc030ae4d service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:09.872302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1357/2713] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:57:16.863965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:16.885170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867216fe-e860-4fcc-8c3d-1790d4cef151 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:16.890592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:16.893407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:16.893407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:16.893407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] PATH_INFO: `/v3/users/56e3ab4354fc48d3bf4b231c7e6ab99b` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:16.893690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e3ab4354fc48d3bf4b231c7e6ab99b)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:16.897598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:17.205336 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e3ab4354fc48d3bf4b231c7e6ab99b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:17.213489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e3ab4354fc48d3bf4b231c7e6ab99b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:17.214554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e3ab4354fc48d3bf4b231c7e6ab99b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:17.214710 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e3ab4354fc48d3bf4b231c7e6ab99b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:17.337750 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e3ab4354fc48d3bf4b231c7e6ab99b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:17.358365 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1357/2714] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:16 2022] DELETE /identity/v3/users/56e3ab4354fc48d3bf4b231c7e6ab99b => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:17.362904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:17.362904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:17.362904 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:17.383612 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:17.384845 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:17.446933 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1358/2715] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:17.456642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:17.458091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:17.472178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:17.523903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5876-ac53-4e7a-af9d-b8c7ed6b333b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:17.528067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:17.528827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:17.529211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:17.529602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:17.541615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:17.543346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:17.567396 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1358/2716] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:18.187819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:18.187819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:18.207318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcac41-c9c5-4f66-97ed-db34eac65bb3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:18.214213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:18.215094 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:18.216325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:18.216325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] PATH_INFO: `/v3/projects/561602c9078c4a23ac69dd7f03519c7e` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:18.217218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561602c9078c4a23ac69dd7f03519c7e)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:18.219193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:18.473216 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:18.474815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:18.489762 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b1180-58cf-427c-a238-26ab84835bb3 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:18.498017 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:18.498965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:18.499286 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:18.499580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] PATH_INFO: `/v3/users/1da333ac86414ffd9661dbd15594e736` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:18.500972 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da333ac86414ffd9661dbd15594e736)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:18.503010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:18.531642 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561602c9078c4a23ac69dd7f03519c7e', 'request_id': 'req-3a034bbd-1dc8-43bd-bef5-1114c6a83459'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.538228 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561602c9078c4a23ac69dd7f03519c7e', 'request_id': 'req-3a034bbd-1dc8-43bd-bef5-1114c6a83459'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.547826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561602c9078c4a23ac69dd7f03519c7e', 'request_id': 'req-3a034bbd-1dc8-43bd-bef5-1114c6a83459'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.648285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] The token cache is being invalidate because project 561602c9078c4a23ac69dd7f03519c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:18.648686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.649406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.650993 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1359/2717] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:18 2022] DELETE /identity/v3/projects/561602c9078c4a23ac69dd7f03519c7e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:18.655111 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:18.656561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:18.732363 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a034bbd-1dc8-43bd-bef5-1114c6a83459 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:18.738254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:18.740797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:18.747023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:18.747023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] PATH_INFO: `/v3/users/2c7d3ca18fd6455faed28e6618f261e8` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:18.747023 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7d3ca18fd6455faed28e6618f261e8)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:18.749558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:18.766837 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:18.794803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da333ac86414ffd9661dbd15594e736'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.802407 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da333ac86414ffd9661dbd15594e736'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.804321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da333ac86414ffd9661dbd15594e736'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.805106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da333ac86414ffd9661dbd15594e736'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.908881 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da333ac86414ffd9661dbd15594e736'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:18.930251 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1359/2718] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:18 2022] DELETE /identity/v3/users/1da333ac86414ffd9661dbd15594e736 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:57:19.015342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7d3ca18fd6455faed28e6618f261e8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.023502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7d3ca18fd6455faed28e6618f261e8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.024223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7d3ca18fd6455faed28e6618f261e8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.024892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7d3ca18fd6455faed28e6618f261e8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.042229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7d3ca18fd6455faed28e6618f261e8'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.125930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1360/2719] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:18 2022] DELETE /identity/v3/users/2c7d3ca18fd6455faed28e6618f261e8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:57:19.233055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:19.234811 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:19.331255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e7418-db76-4bec-b3e5-3d84dbd24396 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:19.362533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:19.394570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:19.395584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:19.395878 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:19.396889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] PATH_INFO: `/v3/projects/7ab25929bbd643a68f0f01f1fb22b292` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:19.399148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab25929bbd643a68f0f01f1fb22b292)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:19.401079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:19.526343 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab25929bbd643a68f0f01f1fb22b292', 'request_id': 'req-b20a0d70-76c1-4101-90ec-9425ad116e2b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.680366 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab25929bbd643a68f0f01f1fb22b292', 'request_id': 'req-b20a0d70-76c1-4101-90ec-9425ad116e2b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.690867 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:19.691669 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab25929bbd643a68f0f01f1fb22b292', 'request_id': 'req-b20a0d70-76c1-4101-90ec-9425ad116e2b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.697182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:19.706564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] The token cache is being invalidate because project 7ab25929bbd643a68f0f01f1fb22b292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:19.706851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.707754 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.710160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1360/2720] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:19 2022] DELETE /identity/v3/projects/7ab25929bbd643a68f0f01f1fb22b292 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:19.713654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:19.715376 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:19.720014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7af8-9c59-4675-9035-84602fa74ec7 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:19.791127 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a0d70-76c1-4101-90ec-9425ad116e2b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:19.792110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:19.793061 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:19.793377 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:19.793667 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] PATH_INFO: `/v3/projects/74668246cac3483c8f7d603b4bff24fa` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:19.794952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74668246cac3483c8f7d603b4bff24fa)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:19.796322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:19.796869 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:19.797207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:19.797535 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:19.797818 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] PATH_INFO: `/v3/users/33a4b747bce449e98cde5c99c16a63eb` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:19.799036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a4b747bce449e98cde5c99c16a63eb)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:19.801170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:19.916589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74668246cac3483c8f7d603b4bff24fa', 'request_id': 'req-055fcb56-5e33-4548-92d7-40f0f52fd799'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.922315 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74668246cac3483c8f7d603b4bff24fa', 'request_id': 'req-055fcb56-5e33-4548-92d7-40f0f52fd799'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:19.929304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74668246cac3483c8f7d603b4bff24fa', 'request_id': 'req-055fcb56-5e33-4548-92d7-40f0f52fd799'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.026925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a4b747bce449e98cde5c99c16a63eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.039637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a4b747bce449e98cde5c99c16a63eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.041799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a4b747bce449e98cde5c99c16a63eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.042533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a4b747bce449e98cde5c99c16a63eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.046797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] The token cache is being invalidate because project 74668246cac3483c8f7d603b4bff24fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:20.049068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.049068 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-055fcb56-5e33-4548-92d7-40f0f52fd799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.049954 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1361/2721] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:19 2022] DELETE /identity/v3/projects/74668246cac3483c8f7d603b4bff24fa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:20.055874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3edcf-e914-4de9-a141-2bef1b4e041c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.056163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3edcf-e914-4de9-a141-2bef1b4e041c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.056429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3edcf-e914-4de9-a141-2bef1b4e041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.075136 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3ab3edcf-e914-4de9-a141-2bef1b4e041c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:20.078172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3ab3edcf-e914-4de9-a141-2bef1b4e041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:20.090879 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:20.142525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1362/2722] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:20.150911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.153103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.153103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.171013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:20.172272 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:20.178273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a4b747bce449e98cde5c99c16a63eb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.180522 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:20.183448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1363/2723] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:57:20.194035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.197424 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4520ff-b949-45cf-b2c2-f0d210d6367c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.209508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.210367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.210623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.210900 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.211697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:57:20.212010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.213686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.214516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1361/2724] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:19 2022] DELETE /identity/v3/users/33a4b747bce449e98cde5c99c16a63eb => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:57:20.231014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1364/2725] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:57:20.232000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.234111 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:20.308458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2428-4c8c-4253-8c06-68ae065013c1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.313428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.314139 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.314434 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.314718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.315447 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.317394 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.426054 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1362/2726] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:57:20 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:57:20.430600 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.440784 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4c5fb-d62c-4d51-9fda-9dbf4929db78 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.506093 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.507022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.507438 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.507886 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.508931 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.511512 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.594976 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1365/2727] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:57:20 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:57:20.598917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.609495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ad23e-c5f9-431d-94ba-9fc314f11745 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.614279 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.614947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.615242 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.615529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.616354 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.618008 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.631840 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1363/2728] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:57:20.640168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.652239 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafeb93-b081-4717-b4d6-ff45aa8c62c6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.657399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.658168 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.658561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.658910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.659721 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.661505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.675943 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.676176 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1366/2729] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:57:20.679788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.680604 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:20.691801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a25ad6-54cf-4868-aed1-a7f254c60a75 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.698060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac3720-745d-4be4-a33c-ad9ab63d8dfc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:20.702991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20eb68-e932-48b8-8371-2dc183f27887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.702991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20eb68-e932-48b8-8371-2dc183f27887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.702991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20eb68-e932-48b8-8371-2dc183f27887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.702991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20eb68-e932-48b8-8371-2dc183f27887 admin admin] PATH_INFO: `/v3/projects/76306680468e4b4ebc7aa6891138fd1c/users/601a2d47f5d74ad88804a4c44b9066cb/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.715960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:20.717151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.717630 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.717907 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] PATH_INFO: `/v3/projects/8e574e097b4d41c0a28fd202b6417017` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.718871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20eb68-e932-48b8-8371-2dc183f27887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76306680468e4b4ebc7aa6891138fd1c, user_id=601a2d47f5d74ad88804a4c44b9066cb, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.720713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e574e097b4d41c0a28fd202b6417017)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:20.722278 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20eb68-e932-48b8-8371-2dc183f27887 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.726049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:20.801060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1367/2730] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:57:20 2022] PUT /identity/v3/projects/76306680468e4b4ebc7aa6891138fd1c/users/601a2d47f5d74ad88804a4c44b9066cb/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:20.812561 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:20.812859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:20.813711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:20.847778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] MFA Rules not processed for user `601a2d47f5d74ad88804a4c44b9066cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:20.848910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:20.854559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e574e097b4d41c0a28fd202b6417017', 'request_id': 'req-fb600ac8-43ab-42e4-a809-073a8a6973f9'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.897641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:20.932277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1368/2731] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:57:20.939454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:20.941302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:20.954581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e574e097b4d41c0a28fd202b6417017', 'request_id': 'req-fb600ac8-43ab-42e4-a809-073a8a6973f9'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.965505 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e574e097b4d41c0a28fd202b6417017', 'request_id': 'req-fb600ac8-43ab-42e4-a809-073a8a6973f9'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.986927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] The token cache is being invalidate because project 8e574e097b4d41c0a28fd202b6417017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:20.987337 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.988443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:20.991380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1364/2732] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:20 2022] DELETE /identity/v3/projects/8e574e097b4d41c0a28fd202b6417017 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:57:21.023451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551ed33-7239-470f-a3e0-9844a862c6a8 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:21.027871 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:21.028538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:21.028823 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:21.029101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:21.031064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:21.044220 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:21.045764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905ff44-c1cb-45e2-b262-53e8b735c56a service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:21.056982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1369/2733] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:57:21.092569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:21.098458 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:21.174305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:21.214601 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb600ac8-43ab-42e4-a809-073a8a6973f9 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:21.220232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:21.221451 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:21.221748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:21.222207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] PATH_INFO: `/v3/users/601a2d47f5d74ad88804a4c44b9066cb` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:21.223786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601a2d47f5d74ad88804a4c44b9066cb)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:21.227653 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:21.533910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601a2d47f5d74ad88804a4c44b9066cb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:21.543196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601a2d47f5d74ad88804a4c44b9066cb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:21.544165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601a2d47f5d74ad88804a4c44b9066cb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:21.545459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601a2d47f5d74ad88804a4c44b9066cb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:21.697525 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601a2d47f5d74ad88804a4c44b9066cb'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:21.718603 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1365/2734] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:21 2022] DELETE /identity/v3/users/601a2d47f5d74ad88804a4c44b9066cb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:21.722975 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:21.723444 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:21.723540 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:21.743242 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:21.744469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:21.818505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1370/2735] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:21.828076 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:21.829654 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:21.901903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ea628-b619-4106-99a2-19aba7390739 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:21.905629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:21.906293 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:21.906581 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:21.906860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:21.917252 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:21.918786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:21.933592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1366/2736] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:22.370812 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:22.372371 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:22.479156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f0bab-d68a-4672-a3e6-27ad9406da27 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:22.488830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:22.489690 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:22.490754 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:22.491003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:22.493572 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:22.555083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:22.585131 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:22.587723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7772a9-2eae-486e-a76e-dd6c1f8a8cb7 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:22.600860 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1371/2737] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:22.734464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:22.736001 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:22.752385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145d1cc-af61-4e5b-90a3-6c03943551cb service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:22.764355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:22.765267 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:22.765583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:22.765889 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] PATH_INFO: `/v3/projects/76306680468e4b4ebc7aa6891138fd1c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:22.767770 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76306680468e4b4ebc7aa6891138fd1c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:22.769812 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:22.991038 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76306680468e4b4ebc7aa6891138fd1c', 'request_id': 'req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:23.137582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76306680468e4b4ebc7aa6891138fd1c', 'request_id': 'req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:23.139169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:23.144352 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76306680468e4b4ebc7aa6891138fd1c', 'request_id': 'req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:23.157558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] The token cache is being invalidate because project 76306680468e4b4ebc7aa6891138fd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:23.157853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:23.158602 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-091fbb0c-1591-46dc-b0dc-0760e3ceaa7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:23.160210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1367/2738] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:22 2022] DELETE /identity/v3/projects/76306680468e4b4ebc7aa6891138fd1c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:23.165795 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.166279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.166381 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.186147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:23.187665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:23.251761 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1372/2739] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:23.260836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.261129 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.261448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.283708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:23.284967 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:23.293787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1368/2740] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:23.298155 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:23.309587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cdf8e-d932-422f-b95c-653657954c70 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:23.320697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:23.321601 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.321945 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.322241 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.323292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:57:23.323472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:23.325476 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:23.341778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1373/2741] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:57:23.345718 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:23.356777 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e57f-47d3-4450-bddf-c5368e381770 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:23.361424 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:23.362059 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.362341 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.362618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.363320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:23.365888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:23.522148 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1369/2742] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:57:23 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:57:23.526526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:23.536622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16807-2110-4b6b-95df-d6027e291387 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:23.597453 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:23.598127 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.598412 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.598708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.600043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:23.602039 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:23.726873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1374/2743] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:57:23 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:57:23.735121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:23.746929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8c41-988b-4900-84da-c50eb087d30d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:23.753448 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822847-3444-422d-b811-4388529531b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:23.753908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822847-3444-422d-b811-4388529531b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.754278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822847-3444-422d-b811-4388529531b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.754888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822847-3444-422d-b811-4388529531b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.756327 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07822847-3444-422d-b811-4388529531b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:23.759051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07822847-3444-422d-b811-4388529531b0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:23.770387 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1370/2744] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:57:23.775430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:23.785709 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f1d3b-2e54-44b2-a456-a280d4eb3562 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:23.791466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06062956-cc43-4c91-ab7e-82dfd6138977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:23.792645 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062956-cc43-4c91-ab7e-82dfd6138977 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.793157 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062956-cc43-4c91-ab7e-82dfd6138977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.793822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062956-cc43-4c91-ab7e-82dfd6138977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.794585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062956-cc43-4c91-ab7e-82dfd6138977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:23.796262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062956-cc43-4c91-ab7e-82dfd6138977 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:23.811079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1375/2745] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:57:23.812374 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822847-3444-422d-b811-4388529531b0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:23.824045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822847-3444-422d-b811-4388529531b0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:23.828958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:23.830084 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:23.830285 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:23.830534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] PATH_INFO: `/v3/projects/93634c53fce14d48892ec6df7c7c0990/users/3b3dab0b04304b12bb10975873d82eb4/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:23.847508 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93634c53fce14d48892ec6df7c7c0990, user_id=3b3dab0b04304b12bb10975873d82eb4, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:23.850423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:23.995848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1371/2746] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:57:23 2022] PUT /identity/v3/projects/93634c53fce14d48892ec6df7c7c0990/users/3b3dab0b04304b12bb10975873d82eb4/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:24.019049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cc36-9cfd-4bbb-a3e9-26e1d6c03a3a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:24.019788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cc36-9cfd-4bbb-a3e9-26e1d6c03a3a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:24.020184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cc36-9cfd-4bbb-a3e9-26e1d6c03a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:24.049631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-55b8cc36-9cfd-4bbb-a3e9-26e1d6c03a3a None None] MFA Rules not processed for user `3b3dab0b04304b12bb10975873d82eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:24.050873 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-55b8cc36-9cfd-4bbb-a3e9-26e1d6c03a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:24.090145 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:24.133902 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1376/2747] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:57:24.147338 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:24.149071 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:24.210786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad45d-db2b-4d73-8e2f-a78b707f48d5 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:24.215514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:24.215514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:24.215778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:24.215904 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:24.238055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:24.239511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:24.250262 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1372/2748] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:34.165468 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=11 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:34.245892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:35.969749 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8a7c-8359-4c11-aecb-0085c0180636 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:35.970270 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8a7c-8359-4c11-aecb-0085c0180636 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:35.970370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8a7c-8359-4c11-aecb-0085c0180636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:35.989627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-70ff8a7c-8359-4c11-aecb-0085c0180636 None None] MFA Rules not processed for user `0ebe6382afe24ef489261081e8610271`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:35.990930 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-70ff8a7c-8359-4c11-aecb-0085c0180636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:36.066060 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1377/2749] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:39.205825 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:39.289673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe086b-26ed-4387-9dd0-43ad421741ff service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:39.295219 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:39.304033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:39.304033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:39.304033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] PATH_INFO: `/v3/users/3b3dab0b04304b12bb10975873d82eb4` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:39.304033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3dab0b04304b12bb10975873d82eb4)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:39.304033 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:39.607835 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3dab0b04304b12bb10975873d82eb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:39.615688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3dab0b04304b12bb10975873d82eb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:39.616523 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3dab0b04304b12bb10975873d82eb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:39.617135 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3dab0b04304b12bb10975873d82eb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:39.706756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3dab0b04304b12bb10975873d82eb4'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:39.751732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1373/2750] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:57:39 2022] DELETE /identity/v3/users/3b3dab0b04304b12bb10975873d82eb4 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:39.755419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:39.756208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:39.756334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:39.777722 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:39.781575 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:39.857686 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1378/2751] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:57:39.869249 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:39.873230 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:39.935256 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd587cb0-a3f7-4eb1-a6be-f6bf48871f85 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:39.939055 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71575f0-8b25-43e1-9d4c-862802f0b20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:39.939715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71575f0-8b25-43e1-9d4c-862802f0b20a service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:39.940007 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71575f0-8b25-43e1-9d4c-862802f0b20a service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:39.940291 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71575f0-8b25-43e1-9d4c-862802f0b20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:39.970719 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71575f0-8b25-43e1-9d4c-862802f0b20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:39.972275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71575f0-8b25-43e1-9d4c-862802f0b20a service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:39.986278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1374/2752] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:57:41.019264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:57:41.022785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:41.035448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2b28-fb2f-4023-9993-c36db00cea6a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:57:41.041571 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:57:41.042830 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:41.043319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:41.044422 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] PATH_INFO: `/v3/projects/93634c53fce14d48892ec6df7c7c0990` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:41.044964 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93634c53fce14d48892ec6df7c7c0990)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:57:41.047048 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:57:41.311261 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93634c53fce14d48892ec6df7c7c0990', 'request_id': 'req-42029ba2-b2ac-4937-8073-9247fe45fa98'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:41.326101 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93634c53fce14d48892ec6df7c7c0990', 'request_id': 'req-42029ba2-b2ac-4937-8073-9247fe45fa98'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:41.336286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93634c53fce14d48892ec6df7c7c0990', 'request_id': 'req-42029ba2-b2ac-4937-8073-9247fe45fa98'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:41.476997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] The token cache is being invalidate because project 93634c53fce14d48892ec6df7c7c0990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:57:41.483095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:41.483095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:57:41.483095 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1379/2753] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:57:41 2022] DELETE /identity/v3/projects/93634c53fce14d48892ec6df7c7c0990 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:57:41.528802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec752084-3bb2-4569-a1fe-d770d0485572 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:57:41.530210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec752084-3bb2-4569-a1fe-d770d0485572 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:57:41.530210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec752084-3bb2-4569-a1fe-d770d0485572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:57:41.550228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ec752084-3bb2-4569-a1fe-d770d0485572 None None] MFA Rules not processed for user `8d1c7f32f0624210ae0ba52c022fea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:57:41.551495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ec752084-3bb2-4569-a1fe-d770d0485572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:57:41.581408 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:41.623161 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1375/2754] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:57:51.471032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:52.738459 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=15 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:04.774579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:58:04.776099 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:04.834785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029ba2-b2ac-4937-8073-9247fe45fa98 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:58:04.838433 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:58:04.839083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:58:04.839370 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:58:04.839654 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:58:04.842091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:04.906146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:58:04.907590 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:58:04.917165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1380/2755] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:58:14.912928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=50 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:23.758300 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:58:23.758810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:58:23.758921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:58:23.777177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] MFA Rules not processed for user `dfc90b18a1f44d1eb1bba4e64fa1d3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:58:23.778449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:23.832739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1376/2756] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:58:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:58:33.825266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=25 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:43.958158 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:58:43.959591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:44.017477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5d6f-f318-4d7b-83aa-001f99962fce service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:58:44.021699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:58:44.027017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:58:44.027017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:58:44.027017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:58:44.027017 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:44.098032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:58:44.099547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532954dc-4695-44b8-82fd-5c1e5a5189f0 service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:58:44.112743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1381/2757] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:58:54.105928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=54 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:55.718319 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:58:55.719703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:55.732618 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a50da-d24f-4544-831f-5be2e88521a6 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:58:55.736642 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:58:55.737304 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:58:55.737600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:58:55.737880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:58:55.739596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:58:55.753311 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:58:55.754752 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:58:55.765934 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1377/2758] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:59:05.761039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=6 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:07.216385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:07.216915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:07.217067 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:07.234454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] MFA Rules not processed for user `8d1c7f32f0624210ae0ba52c022fea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:07.235760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:07.242679 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1382/2759] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:08.002370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:08.003781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:08.077736 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f716ed-1389-41b6-9efe-47f30954332a service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:08.082888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:08.083542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:08.083829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:08.084113 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:08.085941 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:08.098289 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:08.099953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:08.110097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1378/2760] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:59:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:59:12.616021 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:12.617539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:12.632276 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24aa19-817d-4bba-a7ee-cb7df77367b2 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:12.634083 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:12.634735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:12.635027 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:12.635311 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:12.637143 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:12.647302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:12.648692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:12.656953 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1383/2761] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:59:13.538519 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:13.540204 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:13.557013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f95da-50a0-4369-b9aa-a3b348aea0f6 service placement] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:13.564043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:13.564986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:13.565305 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:13.565611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:13.567501 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:13.581872 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:13.583543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:13.596761 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1379/2762] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:59:22.653182 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=9 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:23.593124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=38 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:32.570831 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:32.572284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:32.640708 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a954f33-a9b4-4ea8-b9ad-b75f96b3732f service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:32.645246 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:32.646222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:32.646510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:32.646792 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] PATH_INFO: `/v3/users/dfc90b18a1f44d1eb1bba4e64fa1d3a1` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:32.647992 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc90b18a1f44d1eb1bba4e64fa1d3a1)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:32.649984 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:32.823207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:32.830036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:32.830699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:32.831305 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:32.843306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-18264509-366c-48d4-bee7-0802b929cac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:32.905712 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1384/2763] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:59:32 2022] DELETE /identity/v3/users/dfc90b18a1f44d1eb1bba4e64fa1d3a1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:59:33.141969 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:33.154273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cc6d5-d593-4ef4-af35-ae2c360487d3 service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:33.340061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:33.340823 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:33.341108 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:33.341423 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] PATH_INFO: `/v3/projects/7dddfcc30ee8433c9f48d7153b416f21` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:33.342583 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dddfcc30ee8433c9f48d7153b416f21)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:33.344454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:33.448610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dddfcc30ee8433c9f48d7153b416f21', 'request_id': 'req-04578c8c-2340-4660-8bf5-da16bbeb557e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:33.540094 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dddfcc30ee8433c9f48d7153b416f21', 'request_id': 'req-04578c8c-2340-4660-8bf5-da16bbeb557e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:33.546126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dddfcc30ee8433c9f48d7153b416f21', 'request_id': 'req-04578c8c-2340-4660-8bf5-da16bbeb557e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:33.557875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] The token cache is being invalidate because project 7dddfcc30ee8433c9f48d7153b416f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:59:33.570266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:33.570266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-04578c8c-2340-4660-8bf5-da16bbeb557e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:33.570266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1380/2764] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:59:33 2022] DELETE /identity/v3/projects/7dddfcc30ee8433c9f48d7153b416f21 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:59:33.570595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:33.570595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:33.570595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:33.584457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:33.585787 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:33.647151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1385/2765] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:33.654589 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:33.654884 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:33.655170 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:33.673687 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:33.674897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:33.683015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1381/2766] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:33.687350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:33.698044 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607344fb-099f-4602-a5fd-197fd9426c92 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:33.702589 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:33.703244 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:33.703532 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:33.703813 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:33.704538 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:59:33.704847 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:33.706486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:33.718991 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1386/2767] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:59:33.723233 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:33.732676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6456a0-bb56-456e-add5-9e136885be73 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:33.737625 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:33.738273 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:33.738559 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:33.738962 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:33.739838 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:33.741748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:33.826503 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1382/2768] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:59:33 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:59:33.830960 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:33.842156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d822-e1df-4e64-b449-6b7cdfbb4197 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:33.845736 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:33.900508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:33.901097 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:33.901423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:33.901711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:33.902406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:33.904317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:33.992167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1387/2769] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:59:33 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:59:33.997383 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:34.009051 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e16479-9fce-4e4a-99d2-5d213be87ff4 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:34.016281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:34.016281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:34.016281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:34.016281 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:34.016713 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:34.017232 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:34.029489 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1383/2770] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:59:34.033545 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:34.044809 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234296aa-4233-424a-8c5e-01985a0acf46 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:34.049824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5471716-85fc-4953-ae76-af1acd9f0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:34.050486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471716-85fc-4953-ae76-af1acd9f0c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:34.050778 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471716-85fc-4953-ae76-af1acd9f0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:34.051062 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471716-85fc-4953-ae76-af1acd9f0c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:34.051791 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5471716-85fc-4953-ae76-af1acd9f0c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:34.054334 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5471716-85fc-4953-ae76-af1acd9f0c7c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:34.067078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1388/2771] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:59:34.071970 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:34.082000 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133749da-1d22-4cdd-8d9b-8b6299ff911b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:34.086700 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:34.087565 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:34.087851 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:34.088151 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] PATH_INFO: `/v3/projects/4959857bbf8e4718affb287b5602f17f/users/119b54fb90c0403080ccef2c6b17d0bc/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:34.103302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4959857bbf8e4718affb287b5602f17f, user_id=119b54fb90c0403080ccef2c6b17d0bc, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:34.106086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:34.186543 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1384/2772] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:59:34 2022] PUT /identity/v3/projects/4959857bbf8e4718affb287b5602f17f/users/119b54fb90c0403080ccef2c6b17d0bc/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:59:34.197134 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:34.197461 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:34.197748 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:34.223921 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] MFA Rules not processed for user `119b54fb90c0403080ccef2c6b17d0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:34.225296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:34.291388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1389/2773] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:34.302178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:34.305390 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:34.335897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:34.361733 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb3531-93b4-49bf-acc2-3dba8af7faf1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:34.365958 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276186ad-baf0-451a-8a14-0b300004f8c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:34.366739 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276186ad-baf0-451a-8a14-0b300004f8c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:34.367029 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276186ad-baf0-451a-8a14-0b300004f8c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:34.367314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276186ad-baf0-451a-8a14-0b300004f8c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:34.376004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276186ad-baf0-451a-8a14-0b300004f8c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:34.377471 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276186ad-baf0-451a-8a14-0b300004f8c1 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:34.387192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1385/2774] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:59:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:59:44.288534 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:44.443049 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=14 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:55.297920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:55.361620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a59fc-8b4c-46b7-a29d-487f40f0d167 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:55.366191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:55.367064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:55.367353 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:55.367634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] PATH_INFO: `/v3/users/119b54fb90c0403080ccef2c6b17d0bc` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:55.368854 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119b54fb90c0403080ccef2c6b17d0bc)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:55.370803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:55.582723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119b54fb90c0403080ccef2c6b17d0bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:55.589367 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119b54fb90c0403080ccef2c6b17d0bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:55.591080 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119b54fb90c0403080ccef2c6b17d0bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:55.591683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119b54fb90c0403080ccef2c6b17d0bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:55.603652 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119b54fb90c0403080ccef2c6b17d0bc'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:55.700602 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1390/2775] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 16:59:55 2022] DELETE /identity/v3/users/119b54fb90c0403080ccef2c6b17d0bc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:59:55.705301 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:55.707321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:55.707321 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:55.723314 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:55.724496 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:55.782999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1386/2776] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:55.792699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:55.794262 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:55.850970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c213d-40c3-4d3b-9265-d4ed11da3288 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:55.854463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e25af-1503-4bcb-8ee8-4e5021567057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:55.855098 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e25af-1503-4bcb-8ee8-4e5021567057 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:55.855775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e25af-1503-4bcb-8ee8-4e5021567057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:55.856063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e25af-1503-4bcb-8ee8-4e5021567057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:55.865025 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e25af-1503-4bcb-8ee8-4e5021567057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:55.866504 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e25af-1503-4bcb-8ee8-4e5021567057 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:55.876430 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1391/2777] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:59:56.587015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:56.588580 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:56.601944 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2be9-edbd-4afe-9ef2-f9d2d28baf88 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:56.607495 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:56.608350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:56.608635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:56.608912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] PATH_INFO: `/v3/projects/4959857bbf8e4718affb287b5602f17f` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:56.610240 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4959857bbf8e4718affb287b5602f17f)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:56.612142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:56.757877 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4959857bbf8e4718affb287b5602f17f', 'request_id': 'req-9d17de49-2e2b-42b0-8843-1438ddf5206e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:56.826292 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4959857bbf8e4718affb287b5602f17f', 'request_id': 'req-9d17de49-2e2b-42b0-8843-1438ddf5206e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:56.832429 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4959857bbf8e4718affb287b5602f17f', 'request_id': 'req-9d17de49-2e2b-42b0-8843-1438ddf5206e'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:56.844264 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] The token cache is being invalidate because project 4959857bbf8e4718affb287b5602f17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:59:56.844557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:56.845203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9d17de49-2e2b-42b0-8843-1438ddf5206e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:59:56.846782 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1387/2778] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 16:59:56 2022] DELETE /identity/v3/projects/4959857bbf8e4718affb287b5602f17f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:59:56.851833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:56.852317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:56.852419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:56.869834 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:56.871108 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:56.888693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:56.931296 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1392/2779] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:56.940060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:56.940349 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:56.940628 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:56.961019 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:56.966927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:56.971162 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1388/2780] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:56.975726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:56.985623 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cc572-0cd0-4a5c-b9d7-27105f79494b None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:56.990284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:56.990938 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:56.991230 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:56.991517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:56.992245 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:59:56.992562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:56.994203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.006293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1393/2781] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 16:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:59:57.011021 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:57.020912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a175aa-1795-4915-80e8-d91218e3914c None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:57.025574 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:57.026717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.026717 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.026930 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.028106 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:57.030097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.147499 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1389/2782] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 16:59:57 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:59:57.151827 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:57.162170 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295afef-815f-4473-8e0d-ebb4cf990b49 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:57.219451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:57.220125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.220416 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.220700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.221418 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:57.223389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.329620 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1394/2783] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 16:59:57 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:59:57.333685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:57.344152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8143f7-2641-411e-98d1-a5b2a3bfd797 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:57.348830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:57.349557 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.349850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.350136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.350900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:57.352498 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.364069 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1390/2784] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:59:57.368012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:57.379528 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d8e3-401d-493a-84a0-f1f403500cae admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:57.384428 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadddc7-8c7a-4602-8f91-70940a3aa0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:57.385079 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadddc7-8c7a-4602-8f91-70940a3aa0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.385404 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadddc7-8c7a-4602-8f91-70940a3aa0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.385687 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadddc7-8c7a-4602-8f91-70940a3aa0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.386411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadddc7-8c7a-4602-8f91-70940a3aa0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:57.389200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadddc7-8c7a-4602-8f91-70940a3aa0cb admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.399279 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1395/2785] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 16:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:59:57.403529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:57.413435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4f098-f4ad-423c-9243-973a180c197f admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:57.417986 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:57.418900 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.419188 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.419469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] PATH_INFO: `/v3/projects/30d08b848eb54ba9855407bcdef52d14/users/6e403ec2e4684b8eb884e9aefae351d3/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.434315 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d08b848eb54ba9855407bcdef52d14, user_id=6e403ec2e4684b8eb884e9aefae351d3, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:57.436938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.512965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1391/2786] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 16:59:57 2022] PUT /identity/v3/projects/30d08b848eb54ba9855407bcdef52d14/users/6e403ec2e4684b8eb884e9aefae351d3/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:59:57.518033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cb47-371f-4c8f-96e9-91bc3d7e5e2d None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.518674 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cb47-371f-4c8f-96e9-91bc3d7e5e2d None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.518969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cb47-371f-4c8f-96e9-91bc3d7e5e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.537990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3145cb47-371f-4c8f-96e9-91bc3d7e5e2d None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:59:57.539201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3145cb47-371f-4c8f-96e9-91bc3d7e5e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:57.599201 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1396/2787] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:59:57.609196 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:59:57.610933 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:59:57.632849 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:57.668894 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3facb-b188-446d-a46b-7dcf2ff7dffd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:59:57.673068 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:59:57.673746 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:59:57.674061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:59:57.674344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:59:57.684099 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:59:57.685547 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:59:57.694813 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1392/2788] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:03.423040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:03.423629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:03.424010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:03.473348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] MFA Rules not processed for user `6e403ec2e4684b8eb884e9aefae351d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:03.474594 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:03.504487 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:03.563057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1397/2789] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:03.564248 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:03.577586 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f5459-5b1e-444a-9a3f-04d69460ea61 service neutron] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:03.583116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:03.583827 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:03.584119 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:03.584442 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:03.586631 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:03.595284 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:03.700405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1393/2790] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:00:03 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 17:00:03.702725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:03.716313 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4644e-465e-4c01-9402-1a48098dc092 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:03.835643 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:03.836335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:03.837309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:03.837609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:03.838340 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:03.842029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:03.987429 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1398/2791] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:00:03 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:03.988015 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:03.995533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d07f6a-a7aa-4769-bb98-1a801516b176 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:04.003742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:04.004667 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:04.004957 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:04.005330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:04.006145 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:04.008183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:04.023320 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1394/2792] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 17:00:04.028552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:04.040936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802fa7e-d079-49e0-8601-2efecb56fd79 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:04.048630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:04.049641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:04.049885 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:04.050125 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] PATH_INFO: `/v3/projects/1375438233074ed88843ce0951322326/users/12ef6f4e7560499db2e37478ff314e0c/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:04.072657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1375438233074ed88843ce0951322326, user_id=12ef6f4e7560499db2e37478ff314e0c, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:04.079356 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:04.202526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1399/2793] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:00:04 2022] PUT /identity/v3/projects/1375438233074ed88843ce0951322326/users/12ef6f4e7560499db2e37478ff314e0c/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:00:04.203786 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:04.215960 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562967c-49f1-4923-8cb1-f0df01620c1e admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:04.296272 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:04.297405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:04.298039 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:04.298502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:04.300203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:04.302241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:04.327435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1395/2794] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:04.329240 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:04.340592 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f230e-87fc-4181-9b5c-8ca097c99ebc admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:04.346342 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9946f-bca4-42b5-8608-b8e97ffa40ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:04.347324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9946f-bca4-42b5-8608-b8e97ffa40ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:04.347618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9946f-bca4-42b5-8608-b8e97ffa40ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:04.347948 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9946f-bca4-42b5-8608-b8e97ffa40ee admin admin] PATH_INFO: `/v3/projects/1375438233074ed88843ce0951322326/users/12ef6f4e7560499db2e37478ff314e0c/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:04.350330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9946f-bca4-42b5-8608-b8e97ffa40ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1375438233074ed88843ce0951322326, user_id=12ef6f4e7560499db2e37478ff314e0c, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:04.353040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9946f-bca4-42b5-8608-b8e97ffa40ee admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:04.369208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1400/2795] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:00:04 2022] PUT /identity/v3/projects/1375438233074ed88843ce0951322326/users/12ef6f4e7560499db2e37478ff314e0c/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:08.321270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:08.323964 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:08.430296 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aaff89-c4ab-4ed3-80d0-c7f8356dc27d admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:08.467779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:08.523568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:08.524269 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:08.524624 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:08.524891 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:08.527467 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:08.615748 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:08.617829 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:08.629377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1396/2796] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:10.640616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14244f9e-df56-4442-8b40-b54c9291ffca None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:10.641195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14244f9e-df56-4442-8b40-b54c9291ffca None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:10.641195 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14244f9e-df56-4442-8b40-b54c9291ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:10.675567 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-14244f9e-df56-4442-8b40-b54c9291ffca None None] MFA Rules not processed for user `12ef6f4e7560499db2e37478ff314e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:10.678141 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-14244f9e-df56-4442-8b40-b54c9291ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:10.759448 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:10.770664 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1401/2797] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:10.783266 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:10.790833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:10.890050 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c710a-55ca-4c8c-8d74-4dd02c89276f service nova] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:10.898042 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eee79db5d38448fb7e3c40be668a3cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:10.899183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:10.899627 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:10.900073 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:10.986707 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:10.990297 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:11.002182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1397/2798] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:11.314719 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:11.315472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:11.315997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:11.344103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:11.349959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:11.461660 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1402/2799] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:11.611982 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:11.613688 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:11.652858 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:11.741903 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bbacf-868b-4341-bf17-bc4b488a6b12 service glance] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:11.759594 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca938f5c-ae99-4b93-9beb-2b7367658161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:11.760476 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938f5c-ae99-4b93-9beb-2b7367658161 service swift] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:11.760832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938f5c-ae99-4b93-9beb-2b7367658161 service swift] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:11.761836 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938f5c-ae99-4b93-9beb-2b7367658161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:11.774002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca938f5c-ae99-4b93-9beb-2b7367658161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:11.775649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca938f5c-ae99-4b93-9beb-2b7367658161 service swift] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:11.786985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1398/2800] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 17:00:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:19.866378 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:19.934156 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b1c8-1190-47c5-bd12-e077f28cc8a7 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:19.938459 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:19.939365 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:19.939876 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:19.942191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:19.942191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:20.048214 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:20.050484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:20.064149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1403/2801] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 17:00:21.783680 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=25 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:23.412016 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f906-6637-47b1-88f0-2af6d088b9a3 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:23.412643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f906-6637-47b1-88f0-2af6d088b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:23.412643 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f906-6637-47b1-88f0-2af6d088b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:23.432238 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-f945f906-6637-47b1-88f0-2af6d088b9a3 None None] MFA Rules not processed for user `6e403ec2e4684b8eb884e9aefae351d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:23.434364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-f945f906-6637-47b1-88f0-2af6d088b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:23.441516 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1399/2802] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:23.764057 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:23.775188 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a9d65-a91c-4ca5-9cfa-0c53695d2aee service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:23.785231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:23.785943 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:23.786231 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:23.786915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:23.790582 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:23.801839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:23.803376 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:23.817698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1404/2803] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:27.922599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:27.923122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:27.923228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:27.942866 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:27.944377 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:27.952980 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1400/2804] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Jun 21 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:27.966986 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:27.980304 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21feb6b-8291-41ff-94bf-db8f732ef1c9 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:27.987295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:27.987295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:27.987295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:27.987295 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:27.995723 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:27.997622 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:28.005985 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1405/2805] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 17:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:30.282435 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:30.284428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:30.375385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af5b3-3466-48c0-9624-eaea403663a9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:30.381527 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:30.382803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:30.383399 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:30.384650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:30.387549 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:30.408323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:30.411215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:30.428406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1401/2806] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:30.459249 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:30.460915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:30.493989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dac5a-600d-4b0a-9bce-b1f8215baff4 service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:30.510148 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:30.511924 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:30.512358 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:30.512937 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] PATH_INFO: `/v3/users/0ebe6382afe24ef489261081e8610271` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:30.515978 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebe6382afe24ef489261081e8610271)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:30.520486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:30.577969 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:30.763788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebe6382afe24ef489261081e8610271'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:30.771996 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebe6382afe24ef489261081e8610271'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:30.772983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebe6382afe24ef489261081e8610271'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:30.773764 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebe6382afe24ef489261081e8610271'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:30.816036 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebe6382afe24ef489261081e8610271'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:30.966936 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1406/2807] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:00:30 2022] DELETE /identity/v3/users/0ebe6382afe24ef489261081e8610271 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:00:31.406013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:31.423939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e787d-507d-4c02-a1e2-c076b32bd9bf service placement] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:31.546043 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:31.546921 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:31.547488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:31.547938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] PATH_INFO: `/v3/projects/7a8a0ae0c16a41c8b34547406830813a` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:31.550036 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8a0ae0c16a41c8b34547406830813a)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:31.555985 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:31.749402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8a0ae0c16a41c8b34547406830813a', 'request_id': 'req-9cc52ef8-437e-4489-b524-fc38dab132c0'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:31.871292 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8a0ae0c16a41c8b34547406830813a', 'request_id': 'req-9cc52ef8-437e-4489-b524-fc38dab132c0'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:31.879634 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8a0ae0c16a41c8b34547406830813a', 'request_id': 'req-9cc52ef8-437e-4489-b524-fc38dab132c0'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:31.897417 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] The token cache is being invalidate because project 7a8a0ae0c16a41c8b34547406830813a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:00:31.898066 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:31.898955 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:31.905488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:31.907901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:31.909302 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1402/2808] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:00:31 2022] DELETE /identity/v3/projects/7a8a0ae0c16a41c8b34547406830813a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:31.924406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96134-ef7b-43af-915d-40a4f60254ad admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:32.009822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:32.010995 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:32.011510 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:32.011961 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] PATH_INFO: `/v3/users/177a51423b98406b88ab0133738a8788` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:32.013458 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177a51423b98406b88ab0133738a8788)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:32.015630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:32.197212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177a51423b98406b88ab0133738a8788'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:32.208550 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177a51423b98406b88ab0133738a8788'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:32.212839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177a51423b98406b88ab0133738a8788'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:32.213688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177a51423b98406b88ab0133738a8788'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:32.231406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177a51423b98406b88ab0133738a8788'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:32.312499 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1407/2809] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:00:31 2022] DELETE /identity/v3/users/177a51423b98406b88ab0133738a8788 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:32.622160 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:32.623662 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:32.647203 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc52ef8-437e-4489-b524-fc38dab132c0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:32.669915 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:32.749662 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:32.761324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:32.764558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:32.764558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:32.764808 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:32.765079 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] PATH_INFO: `/v3/projects/227bca94df554c06a22b74319d819d8c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:32.766656 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227bca94df554c06a22b74319d819d8c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:32.770584 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:32.784584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:32.852151 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a47b-a970-4c27-8ece-e278f1d206c6 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:32.857200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:32.857892 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:32.858181 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:32.858462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:32.860292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:32.873606 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:32.875285 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:32.892001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1408/2810] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:32.919141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227bca94df554c06a22b74319d819d8c', 'request_id': 'req-203ef7f8-b54c-4153-83be-3b7952ea50a2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:33.025052 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227bca94df554c06a22b74319d819d8c', 'request_id': 'req-203ef7f8-b54c-4153-83be-3b7952ea50a2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:33.033140 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227bca94df554c06a22b74319d819d8c', 'request_id': 'req-203ef7f8-b54c-4153-83be-3b7952ea50a2'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:33.047025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] The token cache is being invalidate because project 227bca94df554c06a22b74319d819d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:00:33.047346 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:33.048025 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:33.049853 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1403/2811] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:00:32 2022] DELETE /identity/v3/projects/227bca94df554c06a22b74319d819d8c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:00:37.627208 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:37.628710 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:37.643711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27060-7561-4933-a712-30d91182b510 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:37.704744 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:37.705666 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:37.705959 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:37.706243 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] PATH_INFO: `/v3/users/8d1c7f32f0624210ae0ba52c022fea5a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:37.707466 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1c7f32f0624210ae0ba52c022fea5a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:37.709436 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:37.948409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1c7f32f0624210ae0ba52c022fea5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:37.955883 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1c7f32f0624210ae0ba52c022fea5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:37.956598 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1c7f32f0624210ae0ba52c022fea5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:37.957695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1c7f32f0624210ae0ba52c022fea5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:37.972586 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-a2859747-64f1-421b-b6c1-3aa62422fa55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1c7f32f0624210ae0ba52c022fea5a'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:38.059818 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1409/2812] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:00:37 2022] DELETE /identity/v3/users/8d1c7f32f0624210ae0ba52c022fea5a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:38.351987 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:38.353553 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:38.366803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ef7f8-b54c-4153-83be-3b7952ea50a2 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:38.426184 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:38.426968 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:38.427260 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:38.427542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] PATH_INFO: `/v3/projects/97cafcd59ef1433ba71a47a01b3a331c` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:38.428745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97cafcd59ef1433ba71a47a01b3a331c)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:38.430729 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:38.521961 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:38.529380 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cafcd59ef1433ba71a47a01b3a331c', 'request_id': 'req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:38.624611 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cafcd59ef1433ba71a47a01b3a331c', 'request_id': 'req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:38.630723 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cafcd59ef1433ba71a47a01b3a331c', 'request_id': 'req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:38.642923 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] The token cache is being invalidate because project 97cafcd59ef1433ba71a47a01b3a331c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:00:38.643245 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:38.643912 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-f75fbe13-274c-4006-a8e0-d01d3c6c3c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:38.645486 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1404/2813] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:00:38 2022] DELETE /identity/v3/projects/97cafcd59ef1433ba71a47a01b3a331c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:38.650537 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:38.651163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:38.651298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:38.669517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:38.670804 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:38.706733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:38.733970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1410/2814] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:38.741920 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:38.742211 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:38.742491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:38.762131 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:38.763342 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:38.771637 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1405/2815] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:38.776191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:38.786191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19019597-8917-4788-b40a-a1d97050cea6 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:38.791180 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:38.792850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:38.793207 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:38.793525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:38.794462 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 17:00:38.794950 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:38.796901 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:38.811951 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1411/2816] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 17:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 17:00:38.816427 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:38.825977 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56ced3-517a-4ecf-aa36-84ca7525e202 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:38.830690 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:38.832416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:38.832416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:38.832416 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:38.832711 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:38.834521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:38.934815 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1406/2817] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:00:38 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:38.939123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:38.949486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfc806-8a61-4dcd-b3a1-8b4014263a44 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:39.011022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:39.011693 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:39.011977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:39.012254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:39.012939 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:39.015033 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:39.115661 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1412/2818] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:00:38 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:39.121009 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:39.131282 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcea6d-5139-4c98-9d85-dcc637bb02f3 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:39.136743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:39.137469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:39.137804 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:39.138097 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:39.138834 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:39.140661 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:39.152397 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1407/2819] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:39.156579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:39.166729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde1c46-e54b-4b75-b47a-89d3fd468517 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:39.172312 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099366-5aaa-47cd-85e3-409e85e27bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:39.172982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099366-5aaa-47cd-85e3-409e85e27bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:39.173299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099366-5aaa-47cd-85e3-409e85e27bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:39.173715 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099366-5aaa-47cd-85e3-409e85e27bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:39.174449 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099366-5aaa-47cd-85e3-409e85e27bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:39.176076 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099366-5aaa-47cd-85e3-409e85e27bf0 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:39.186941 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1413/2820] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:39.191344 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:39.201554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f18cf-fb56-43dc-95b2-84ebae121238 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:39.206146 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:39.207195 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:39.207491 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:39.207768 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] PATH_INFO: `/v3/projects/cfdb9dba9a714ceeb3d5505741c2dd67/users/ceeefe8af382422e9892b0f3c5c0ece1/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:39.224134 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb9dba9a714ceeb3d5505741c2dd67, user_id=ceeefe8af382422e9892b0f3c5c0ece1, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:39.226983 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:39.326966 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1408/2821] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:00:39 2022] PUT /identity/v3/projects/cfdb9dba9a714ceeb3d5505741c2dd67/users/ceeefe8af382422e9892b0f3c5c0ece1/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:39.337153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:39.337542 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:39.337826 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:39.367839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] MFA Rules not processed for user `ceeefe8af382422e9892b0f3c5c0ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:39.369096 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:39.434191 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1414/2822] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 17:00:39.444913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:39.446802 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:39.504950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e465f9-7404-4399-a95a-56c577bdc7bc admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:39.508817 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:39.509560 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:39.509852 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:39.510692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:39.519228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:39.520650 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:39.530358 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1409/2823] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:44.067043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:44.073880 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:44.107289 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:44.146627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2a15-5abc-40fa-ba74-e5fb6fdb910e None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:44.153322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:44.154103 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:44.154395 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:44.154731 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:44.156549 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:44.169698 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:44.171409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fc399-3bbe-49f3-ba87-0c2fc6c7cfd2 service nova] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:44.185511 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1415/2824] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:49.525607 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:50.015674 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:50.129529 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36332e92-eae8-4d49-a3ff-2484f1b94928 service cinder] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:50.134494 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:50.135370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:50.135657 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:50.135973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] PATH_INFO: `/v3/users/ceeefe8af382422e9892b0f3c5c0ece1` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:50.137897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceeefe8af382422e9892b0f3c5c0ece1)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:50.139897 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:50.374425 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceeefe8af382422e9892b0f3c5c0ece1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:50.380965 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceeefe8af382422e9892b0f3c5c0ece1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:50.381652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceeefe8af382422e9892b0f3c5c0ece1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:50.382504 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceeefe8af382422e9892b0f3c5c0ece1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:50.470406 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceeefe8af382422e9892b0f3c5c0ece1'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:50.497531 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1410/2825] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:00:50 2022] DELETE /identity/v3/users/ceeefe8af382422e9892b0f3c5c0ece1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:50.502425 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:50.502915 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:50.503035 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:50.553631 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:50.554896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:50.615488 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1416/2826] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:50.632974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:50.632974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:50.669258 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:50.721953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252cca-ec4d-4d62-b78d-9ff6575eb9d0 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:50.726483 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce19343-6645-400f-bc87-6aec717654d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:50.727126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19343-6645-400f-bc87-6aec717654d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:50.727411 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19343-6645-400f-bc87-6aec717654d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:50.727685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19343-6645-400f-bc87-6aec717654d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:50.737950 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce19343-6645-400f-bc87-6aec717654d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:50.739778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce19343-6645-400f-bc87-6aec717654d9 service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:50.750438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1411/2827] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:51.341597 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:51.343051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:51.358865 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eb5d2-7bdc-4613-9c8f-27fbbfd475af None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:51.364495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:51.365513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:51.365803 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:51.366133 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] PATH_INFO: `/v3/projects/cfdb9dba9a714ceeb3d5505741c2dd67` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:51.367591 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdb9dba9a714ceeb3d5505741c2dd67)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:51.369536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:51.522091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdb9dba9a714ceeb3d5505741c2dd67', 'request_id': 'req-cd4c145a-e503-42ef-8940-699e1d1e2eda'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:51.528587 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdb9dba9a714ceeb3d5505741c2dd67', 'request_id': 'req-cd4c145a-e503-42ef-8940-699e1d1e2eda'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:51.534828 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdb9dba9a714ceeb3d5505741c2dd67', 'request_id': 'req-cd4c145a-e503-42ef-8940-699e1d1e2eda'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:51.635316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] The token cache is being invalidate because project cfdb9dba9a714ceeb3d5505741c2dd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:00:51.635609 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:51.637022 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-cd4c145a-e503-42ef-8940-699e1d1e2eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:51.638891 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1417/2828] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:00:51 2022] DELETE /identity/v3/projects/cfdb9dba9a714ceeb3d5505741c2dd67 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:51.645144 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:51.645692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:51.645830 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:51.664673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:51.668714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:51.725868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1412/2829] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 17:00:51.735203 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:51.735505 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:51.735836 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:51.755219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:51.756456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:51.765689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1418/2830] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:51.770372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:51.786040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70a44f-475a-4f24-a662-7b0c956454ab None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:51.786040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:51.786040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:51.786040 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:51.786536 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:51.786803 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 17:00:51.787115 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:51.788708 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:51.800635 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1413/2831] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 17:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 17:00:51.805186 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:51.815213 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28144f-bb1c-4001-b1cc-d8b38a9aeb8a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:51.820140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:51.823440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:51.823440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:51.823440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:51.823440 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:51.825040 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:51.829013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:51.956298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1419/2832] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:00:51 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:51.960753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:51.971701 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84b9d-1285-4c2d-a7f7-900af27afce1 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.029741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.030410 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.030698 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.030984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.031692 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.033622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.151250 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1414/2833] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:00:51 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:52.155202 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.165630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4dd5-4a1d-4b4f-8252-fd1854ec099b admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.171574 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.172286 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.172579 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.179184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.179184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.179184 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.186807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1420/2834] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:52.190989 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.202124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbad08-0437-4c99-a8cb-f4fe2ad28f61 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.206694 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fec4-b18d-4df4-9d43-4e5cbb4b1312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.214347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fec4-b18d-4df4-9d43-4e5cbb4b1312 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.214347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fec4-b18d-4df4-9d43-4e5cbb4b1312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.214347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fec4-b18d-4df4-9d43-4e5cbb4b1312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.214347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9fec4-b18d-4df4-9d43-4e5cbb4b1312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.214347 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9fec4-b18d-4df4-9d43-4e5cbb4b1312 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.220753 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1415/2835] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:52.224932 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.239029 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192b0a-6807-4ec5-b516-c803b813643d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.243599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.244472 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.248124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.248124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] PATH_INFO: `/v3/projects/bb2e996fbd7741f3bb989402ef4e70bf/users/48a8b08f2c6b4316bfbeb154433c1b4d/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.260319 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2e996fbd7741f3bb989402ef4e70bf, user_id=48a8b08f2c6b4316bfbeb154433c1b4d, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.263150 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.350229 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1421/2836] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:00:52 2022] PUT /identity/v3/projects/bb2e996fbd7741f3bb989402ef4e70bf/users/48a8b08f2c6b4316bfbeb154433c1b4d/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:52.361306 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.361533 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.361821 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.380756 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:52.389124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] MFA Rules not processed for user `48a8b08f2c6b4316bfbeb154433c1b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:52.390364 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:52.456542 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1416/2837] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:52.461013 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.523227 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f15f-fdf7-4555-97b6-c4cb4f349f25 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.528789 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.529477 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.529766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.530045 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.530735 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.532651 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.669554 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1422/2838] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:00:52 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:52.670799 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.681520 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f9886-cfdd-4b4c-8156-d9be23aaf02b None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.739697 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.741199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.741199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.741199 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.742056 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.744595 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.894355 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1417/2839] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:00:52 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:52.898348 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.909558 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9c641-a5d2-4e33-a276-c87e7892fd17 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.914172 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.914833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.915122 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.915406 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.916130 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.917850 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:52.928703 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1423/2840] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:52.933003 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:52.943322 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dab693-c5bf-45ec-8736-90f446712f88 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:52.947886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:52.949403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:52.949695 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:52.949984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] PATH_INFO: `/v3/projects/400e321def014076b289b6b63d7c0f1a/users/b1b7002dc9a147e48543a687d2a3de41/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:52.966182 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400e321def014076b289b6b63d7c0f1a, user_id=b1b7002dc9a147e48543a687d2a3de41, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:52.968819 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:53.040469 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1418/2841] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:00:52 2022] PUT /identity/v3/projects/400e321def014076b289b6b63d7c0f1a/users/b1b7002dc9a147e48543a687d2a3de41/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:00:53.044627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:53.054655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391be16-d756-495f-a247-29efcae92c62 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:53.114146 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553f07f-a87d-42c6-9191-5e3f577a39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:53.114819 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f07f-a87d-42c6-9191-5e3f577a39ed admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:53.115106 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f07f-a87d-42c6-9191-5e3f577a39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:53.115391 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553f07f-a87d-42c6-9191-5e3f577a39ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:53.116116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553f07f-a87d-42c6-9191-5e3f577a39ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:53.117760 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553f07f-a87d-42c6-9191-5e3f577a39ed admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:53.128414 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1424/2842] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:00:53.132888 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:53.144152 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c671-2f78-4043-99cd-ec6509121a83 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:53.148781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:53.149685 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:53.151848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:53.151848 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] PATH_INFO: `/v3/projects/400e321def014076b289b6b63d7c0f1a/users/b1b7002dc9a147e48543a687d2a3de41/roles/226a8ee9fffe4695abdd8ff7ca4f1eba` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:53.152214 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400e321def014076b289b6b63d7c0f1a, user_id=b1b7002dc9a147e48543a687d2a3de41, role_id=226a8ee9fffe4695abdd8ff7ca4f1eba)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:53.154880 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:53.165703 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1419/2843] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:00:53 2022] PUT /identity/v3/projects/400e321def014076b289b6b63d7c0f1a/users/b1b7002dc9a147e48543a687d2a3de41/roles/226a8ee9fffe4695abdd8ff7ca4f1eba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:53.176384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:53.184766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:53.184766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:53.206639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] MFA Rules not processed for user `b1b7002dc9a147e48543a687d2a3de41`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:53.207879 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:53.217364 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:53.276508 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1425/2844] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:53.287540 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:53.289254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:53.348449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb31c27-8045-4608-b63c-c1805ac954e5 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:53.352177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8f14-f0e2-4233-b1dc-c03f86e5e23c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:53.352847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8f14-f0e2-4233-b1dc-c03f86e5e23c service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:53.353136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8f14-f0e2-4233-b1dc-c03f86e5e23c service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:53.353455 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8f14-f0e2-4233-b1dc-c03f86e5e23c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:53.358913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:53.410446 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae8f14-f0e2-4233-b1dc-c03f86e5e23c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:53.411886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae8f14-f0e2-4233-b1dc-c03f86e5e23c service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:53.421636 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1420/2845] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:56.671982 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:56.735120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602330ac-31b7-4e03-a588-8b7cf281d139 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:56.739655 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:56.740520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:56.740811 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:56.741092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] PATH_INFO: `/v3/users/48a8b08f2c6b4316bfbeb154433c1b4d` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:56.742317 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a8b08f2c6b4316bfbeb154433c1b4d)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:56.744359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:56.963469 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a8b08f2c6b4316bfbeb154433c1b4d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:56.970580 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a8b08f2c6b4316bfbeb154433c1b4d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:56.974251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a8b08f2c6b4316bfbeb154433c1b4d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:56.974251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a8b08f2c6b4316bfbeb154433c1b4d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:56.983614 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a8b08f2c6b4316bfbeb154433c1b4d'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:57.070595 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1426/2846] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:00:56 2022] DELETE /identity/v3/users/48a8b08f2c6b4316bfbeb154433c1b4d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:57.076091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:57.076640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:57.076640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:57.094649 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:57.095859 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:57.157779 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1421/2847] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:57.168082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:57.169700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:57.201700 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:57.228581 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b7854-dd08-4f3f-a457-789d5b9cc8ca admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:57.232843 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:57.233525 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:57.233912 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:57.234204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:57.243539 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:57.245153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:57.255683 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1427/2848] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:57.728988 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:57.731488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:57.744116 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7eac6-b9fa-4573-8da7-4109df0c13b9 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:57.749456 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:57.750332 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:57.750623 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:57.750901 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] PATH_INFO: `/v3/projects/bb2e996fbd7741f3bb989402ef4e70bf` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:57.752183 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2e996fbd7741f3bb989402ef4e70bf)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:57.754165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:57.952764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2e996fbd7741f3bb989402ef4e70bf', 'request_id': 'req-5a044f54-2b3b-4c67-a592-f90ba4f4439c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.035798 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2e996fbd7741f3bb989402ef4e70bf', 'request_id': 'req-5a044f54-2b3b-4c67-a592-f90ba4f4439c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.042061 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2e996fbd7741f3bb989402ef4e70bf', 'request_id': 'req-5a044f54-2b3b-4c67-a592-f90ba4f4439c'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.054385 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] The token cache is being invalidate because project bb2e996fbd7741f3bb989402ef4e70bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:00:58.054681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.055330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.056910 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1422/2849] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:00:57 2022] DELETE /identity/v3/projects/bb2e996fbd7741f3bb989402ef4e70bf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:58.062149 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:58.071626 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11d1a6-9eb6-41b4-81c5-9a2a5f0537f0 service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:58.129219 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:58.130144 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:58.130463 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:58.130747 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] PATH_INFO: `/v3/users/b1b7002dc9a147e48543a687d2a3de41` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:58.131952 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b7002dc9a147e48543a687d2a3de41)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:58.134204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:58.456199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b7002dc9a147e48543a687d2a3de41'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.464557 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b7002dc9a147e48543a687d2a3de41'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.465456 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b7002dc9a147e48543a687d2a3de41'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.466091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b7002dc9a147e48543a687d2a3de41'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.479714 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b7002dc9a147e48543a687d2a3de41'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:58.573200 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1428/2850] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:00:58 2022] DELETE /identity/v3/users/b1b7002dc9a147e48543a687d2a3de41 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:58.796067 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:58.798464 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:58.838764 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:58.864546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044f54-2b3b-4c67-a592-f90ba4f4439c admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:58.914727 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:58.915384 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:58.915672 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:58.915953 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:58.917978 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:58.986241 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:58.987592 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ef4f-2f5b-49ed-9baa-44dc4db92f7d service neutron] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:58.997426 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1423/2851] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:00:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:00:59.099852 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:59.101321 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:59.155619 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:59.171058 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba8cc-8042-4107-8503-1185148c3247 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:59.175684 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:59.176547 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.176833 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.177110 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] PATH_INFO: `/v3/projects/400e321def014076b289b6b63d7c0f1a` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.178322 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400e321def014076b289b6b63d7c0f1a)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:59.180235 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:59.345780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400e321def014076b289b6b63d7c0f1a', 'request_id': 'req-00248bb3-f71b-45c9-8740-9d812be81241'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:59.351318 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400e321def014076b289b6b63d7c0f1a', 'request_id': 'req-00248bb3-f71b-45c9-8740-9d812be81241'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:59.359051 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400e321def014076b289b6b63d7c0f1a', 'request_id': 'req-00248bb3-f71b-45c9-8740-9d812be81241'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:59.458400 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] The token cache is being invalidate because project 400e321def014076b289b6b63d7c0f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:00:59.458842 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:59.459771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-00248bb3-f71b-45c9-8740-9d812be81241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:00:59.461409 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1429/2852] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:00:59 2022] DELETE /identity/v3/projects/400e321def014076b289b6b63d7c0f1a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:00:59.466856 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.467150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.467436 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.511842 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:59.512886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:59.578926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1424/2853] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 17:00:59.588484 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.588780 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.589562 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.610292 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:00:59.611585 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:00:59.620224 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1430/2854] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:00:59.625418 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:59.636253 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64b09b-be4a-4938-92b8-22238ef5fb8a None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:59.641550 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:59.642237 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.642599 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.642926 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.643673 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 17:00:59.643993 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:59.645738 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:59.662564 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1425/2855] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 17:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 17:00:59.663868 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:59.674432 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d87be-39b3-4c8c-bb95-7dccdd487bd9 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:59.679529 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:59.680264 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.680552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.682669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] PATH_INFO: `/v3/projects` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.682669 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:59.684199 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:59.792596 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1431/2856] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:00:59 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:59.797334 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:59.807914 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e3bc-aa73-4c8f-b1f7-8930b9a07f56 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:59.812833 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=100 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:59.863832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:59.864431 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.864726 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.865013 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.865790 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:00:59.867742 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:00:59.975402 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1426/2857] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:00:59 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:00:59.980389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:00:59.991147 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb47f8-46d5-4e7f-981e-b53b1649534c admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:00:59.996302 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:00:59.997049 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:00:59.997385 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:00:59.997668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:00:59.998423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:00.000132 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:00.012801 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1432/2858] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 17:01:00.017091 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:00.028511 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85a8af-19cb-4c73-a46f-9836cfea5fdd admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:00.033200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f870b-96cb-4c72-8ac3-233dbefc3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:00.033892 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f870b-96cb-4c72-8ac3-233dbefc3630 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:00.034177 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f870b-96cb-4c72-8ac3-233dbefc3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:00.034454 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f870b-96cb-4c72-8ac3-233dbefc3630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:00.035171 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f870b-96cb-4c72-8ac3-233dbefc3630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:00.036784 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f870b-96cb-4c72-8ac3-233dbefc3630 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:00.048546 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1427/2859] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:01:00.058782 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:00.069003 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e26d3-a418-4d00-b003-5d5e1fe32ac8 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:00.074552 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:00.075526 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:00.076043 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:00.076388 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] PATH_INFO: `/v3/projects/4b8149068f374414be3af11cdfe23b6e/users/66e45998d47d43029f55cddaebf48680/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:00.093840 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8149068f374414be3af11cdfe23b6e, user_id=66e45998d47d43029f55cddaebf48680, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:00.096517 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:00.220267 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1433/2860] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:01:00 2022] PUT /identity/v3/projects/4b8149068f374414be3af11cdfe23b6e/users/66e45998d47d43029f55cddaebf48680/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:01:00.230927 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:00.231328 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:00.231715 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:00.258679 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] MFA Rules not processed for user `66e45998d47d43029f55cddaebf48680`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:00.260178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:00.330908 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1428/2861] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:00.343413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:00.345212 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:00.403480 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291d67-fe10-45ec-892f-b9579141b1cd admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:00.407073 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:00.407726 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:00.408018 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:00.408306 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:00.416757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:00.418533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:00.427641 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1434/2862] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:01:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:01:01.506317 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:01.508087 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:01.588622 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9894648-6ad0-4978-90eb-466d05e1aa09 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:01.595664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9687c85240694148aa572d8807ada25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:01.596403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:01.596772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:01.597178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:01.599178 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:01.613551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:01.615275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149c36-3bc5-4e9a-8087-c1d5274bc452 service nova] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:01.629475 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1429/2863] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:01:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:01:10.423389 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:11.622928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:41.778743 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:41.841616 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844994b9-d1a2-4f0e-bc59-b179ee4ac29a service cinder] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:41.847294 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:41.848165 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:41.848450 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:41.848729 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] PATH_INFO: `/v3/users/66e45998d47d43029f55cddaebf48680` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:41.849911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e45998d47d43029f55cddaebf48680)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:41.851824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:42.020012 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e45998d47d43029f55cddaebf48680'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.026755 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e45998d47d43029f55cddaebf48680'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.027420 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e45998d47d43029f55cddaebf48680'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.028032 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e45998d47d43029f55cddaebf48680'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.040426 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e45998d47d43029f55cddaebf48680'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.110222 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1435/2864] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:01:41 2022] DELETE /identity/v3/users/66e45998d47d43029f55cddaebf48680 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:01:42.115045 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:42.115629 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:42.115741 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:42.135026 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:42.138255 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:42.197194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1430/2865] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:42.208124 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:42.209492 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:42.269859 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffbe0-7312-4636-8f48-99bb67446612 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:42.279689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0a7a-c97f-4dd2-a753-01dd0b723d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:42.279689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0a7a-c97f-4dd2-a753-01dd0b723d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:42.279689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0a7a-c97f-4dd2-a753-01dd0b723d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:42.279689 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0a7a-c97f-4dd2-a753-01dd0b723d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:42.284907 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0a7a-c97f-4dd2-a753-01dd0b723d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:42.286419 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0a7a-c97f-4dd2-a753-01dd0b723d0a service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:42.296495 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1436/2866] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 17:01:42.733521 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:42.734952 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:42.752860 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c5c9d-6778-4dd7-a5e7-4bdd705fa3aa None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:42.758060 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:42.759018 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:42.759313 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:42.759596 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] PATH_INFO: `/v3/projects/4b8149068f374414be3af11cdfe23b6e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:42.760795 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8149068f374414be3af11cdfe23b6e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:42.762735 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:42.902783 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8149068f374414be3af11cdfe23b6e', 'request_id': 'req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.981591 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8149068f374414be3af11cdfe23b6e', 'request_id': 'req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:42.990917 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8149068f374414be3af11cdfe23b6e', 'request_id': 'req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:43.002138 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] The token cache is being invalidate because project 4b8149068f374414be3af11cdfe23b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:01:43.002428 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:43.003089 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-5ec65328-8914-4a6d-a0ff-f2e3e4419d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:43.004652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1431/2867] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:01:42 2022] DELETE /identity/v3/projects/4b8149068f374414be3af11cdfe23b6e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:01:43.009970 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.010695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.010695 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.041218 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:43.042457 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:43.052330 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:43.104335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1437/2868] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:43.113994 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.114370 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.114721 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.133270 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:43.135638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:43.143659 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1432/2869] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:43.147997 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.159001 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa17f11-7c2d-47b8-b6f1-f4a13b365868 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.163965 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.164627 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.164920 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.165209 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.166053 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 17:01:43.166410 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.168116 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.180593 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1438/2870] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 17:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 17:01:43.185132 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.194514 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3b72e-8f7d-465f-b311-b09771f0faaa None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.199201 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.204339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.204339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.204339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.204339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.204339 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.328582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1433/2871] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:01:43.332491 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.343092 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b615e-3a53-4117-aecd-09a0059a7b29 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.403193 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.403874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.404166 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.404451 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.405160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.407153 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.497746 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1439/2872] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:01:43 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:01:43.502159 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.513086 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813763f-3729-41d6-8050-101077d3d5a8 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.517847 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.518500 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.518788 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.519082 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.519816 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.521422 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.531973 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1434/2873] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:01:43.536309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.546090 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8abc6-804d-4e4b-a775-a125786565b2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.551699 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72ba0-9b8a-4620-a6eb-6c39d74deb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.552347 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72ba0-9b8a-4620-a6eb-6c39d74deb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.552634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72ba0-9b8a-4620-a6eb-6c39d74deb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.552935 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72ba0-9b8a-4620-a6eb-6c39d74deb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.553692 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72ba0-9b8a-4620-a6eb-6c39d74deb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.555293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72ba0-9b8a-4620-a6eb-6c39d74deb27 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.566309 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1440/2874] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:01:43.570620 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.580999 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510d87-9a93-4dae-bf02-2b548e894034 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.585510 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.586372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.586652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.586928 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] PATH_INFO: `/v3/projects/cce5b511756f49eeba19c00b44827efb/users/c8d1977dd35e46c7a4a970dac4ce8e9f/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.602112 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce5b511756f49eeba19c00b44827efb, user_id=c8d1977dd35e46c7a4a970dac4ce8e9f, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.604745 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.681492 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1435/2875] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:01:43 2022] PUT /identity/v3/projects/cce5b511756f49eeba19c00b44827efb/users/c8d1977dd35e46c7a4a970dac4ce8e9f/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:01:43.692325 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.694054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.694054 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.719112 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] MFA Rules not processed for user `c8d1977dd35e46c7a4a970dac4ce8e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:43.720875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:43.785064 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1441/2876] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:43.795638 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:43.797350 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:43.820869 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:43.876205 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36946e2d-aa2a-4f96-b468-f7fe881f4f11 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:43.879938 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398305d2-2bee-435d-89d7-d4c76674e378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:43.880582 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398305d2-2bee-435d-89d7-d4c76674e378 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:43.880868 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398305d2-2bee-435d-89d7-d4c76674e378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:43.881150 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398305d2-2bee-435d-89d7-d4c76674e378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:43.890215 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398305d2-2bee-435d-89d7-d4c76674e378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:43.891640 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398305d2-2bee-435d-89d7-d4c76674e378 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:43.900461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1436/2877] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:01:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:01:53.781520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:53.914616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=26 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:54.981820 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:55.044665 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7eb6-bc3d-47cc-a768-701f5ad80ac3 None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:55.049123 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:55.050014 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:55.050299 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:55.050635 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] PATH_INFO: `/v3/users/c8d1977dd35e46c7a4a970dac4ce8e9f` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:55.052329 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d1977dd35e46c7a4a970dac4ce8e9f)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:55.054310 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:55.247350 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d1977dd35e46c7a4a970dac4ce8e9f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:55.254688 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d1977dd35e46c7a4a970dac4ce8e9f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:55.258857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d1977dd35e46c7a4a970dac4ce8e9f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:55.258857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d1977dd35e46c7a4a970dac4ce8e9f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:55.268967 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d1977dd35e46c7a4a970dac4ce8e9f'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:55.352082 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1442/2878] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:01:54 2022] DELETE /identity/v3/users/c8d1977dd35e46c7a4a970dac4ce8e9f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:01:55.356676 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:55.357141 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:55.360126 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:55.375165 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:55.376484 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:55.435598 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1437/2879] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:55.446390 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:55.447807 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:55.505653 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a307dbb-7d41-4385-b0b6-206a06b4fc6d admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:55.509536 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45910be-1f91-48d9-a942-feb92d17d8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:55.510194 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45910be-1f91-48d9-a942-feb92d17d8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:55.510486 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45910be-1f91-48d9-a942-feb92d17d8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:55.510771 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45910be-1f91-48d9-a942-feb92d17d8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:55.520607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45910be-1f91-48d9-a942-feb92d17d8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:55.522071 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45910be-1f91-48d9-a942-feb92d17d8f2 service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:55.531857 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1443/2880] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 17:01:55.933814 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:55.935235 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:55.948192 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1126fa-b9ed-4871-abbf-9192cd17c084 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:55.952841 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:55.953665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:55.953947 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:55.954225 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] PATH_INFO: `/v3/projects/cce5b511756f49eeba19c00b44827efb` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:55.955403 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce5b511756f49eeba19c00b44827efb)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:55.957578 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.085513 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce5b511756f49eeba19c00b44827efb', 'request_id': 'req-79ca917c-6f59-4511-9df3-4568f1763148'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:56.178333 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce5b511756f49eeba19c00b44827efb', 'request_id': 'req-79ca917c-6f59-4511-9df3-4568f1763148'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:56.184984 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce5b511756f49eeba19c00b44827efb', 'request_id': 'req-79ca917c-6f59-4511-9df3-4568f1763148'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:56.196626 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] The token cache is being invalidate because project cce5b511756f49eeba19c00b44827efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:01:56.196925 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:56.197600 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-79ca917c-6f59-4511-9df3-4568f1763148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:01:56.199220 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1438/2881] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:01:55 2022] DELETE /identity/v3/projects/cce5b511756f49eeba19c00b44827efb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:01:56.204091 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.216874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.216874 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.223384 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:56.224599 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:56.242034 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:56.285911 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1444/2882] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:56.295231 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.297070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.297070 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.314554 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:56.315771 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:56.323722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1439/2883] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:56.339357 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:56.351120 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8a10e-2814-4d6a-9043-ee8c34793a4a None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:56.355839 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:56.356533 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.356824 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.357138 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.357909 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 17:01:56.358298 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:56.359910 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.372300 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1445/2884] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jun 21 17:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 17:01:56.376743 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:56.386913 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc21e0-42c5-408d-9ab6-79baade8ab67 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:56.391515 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:56.392136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.392452 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.396124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.396124 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:56.396351 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.502210 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1440/2885] 10.222.0.70 () {60 vars in 1152 bytes} [Tue Jun 21 17:01:56 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:01:56.555324 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:56.565668 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bf650-eb2c-4f2a-b629-3a022fdf39a2 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:56.621822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:56.622413 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.622702 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.622983 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] PATH_INFO: `/v3/users` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.623677 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:56.625634 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.726670 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1446/2886] 10.222.0.70 () {60 vars in 1143 bytes} [Tue Jun 21 17:01:56 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 17:01:56.730573 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:56.741006 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609647ec-b169-47e2-a322-be1a488523ea admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:56.751681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:56.751681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.751681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.751681 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.752122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:56.752122 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.761290 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1441/2887] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:01:56.765206 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:56.776944 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c8b8-05d3-43d4-bcb7-7dad893db553 admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:56.781513 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dab5a1-7cf4-4d6c-9da0-983983345c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:56.782159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dab5a1-7cf4-4d6c-9da0-983983345c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.782445 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dab5a1-7cf4-4d6c-9da0-983983345c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.782725 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dab5a1-7cf4-4d6c-9da0-983983345c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.783443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dab5a1-7cf4-4d6c-9da0-983983345c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:56.785607 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dab5a1-7cf4-4d6c-9da0-983983345c61 admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.795775 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1447/2888] 10.222.0.70 () {58 vars in 1121 bytes} [Tue Jun 21 17:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 17:01:56.800002 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:56.810121 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54994a4-b3d9-4c02-ada1-bd59b1f74218 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:56.814675 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:56.815502 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.815787 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.816886 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] PATH_INFO: `/v3/projects/20757c7daaf7423ebc0878f3fe96e41e/users/ba95237de6944defa735d9422fb70d66/roles/e446eb256dc14055b69a04a154fdc373` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.831243 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20757c7daaf7423ebc0878f3fe96e41e, user_id=ba95237de6944defa735d9422fb70d66, role_id=e446eb256dc14055b69a04a154fdc373)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:56.834714 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:56.932569 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1442/2889] 10.222.0.70 () {60 vars in 1482 bytes} [Tue Jun 21 17:01:56 2022] PUT /identity/v3/projects/20757c7daaf7423ebc0878f3fe96e41e/users/ba95237de6944defa735d9422fb70d66/roles/e446eb256dc14055b69a04a154fdc373 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:01:56.942989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] REQUEST_METHOD: `POST` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:56.943282 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:56.943569 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:56.970877 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.auth.core [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] MFA Rules not processed for user `ba95237de6944defa735d9422fb70d66`. Rule list: `[]` (Enabled: `True`). {{(pid=80609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:01:56.972140 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:57.034393 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1448/2890] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:01:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:01:57.045850 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:01:57.047525 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:01:57.071010 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:57.105323 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1900-df7d-439b-9c72-981cd7244767 admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:01:57.109558 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e2a6-5bb6-4381-ac9d-c790981bb3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f5efc58077843358aeb93e42997f2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:01:57.110207 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e2a6-5bb6-4381-ac9d-c790981bb3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:01:57.110497 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e2a6-5bb6-4381-ac9d-c790981bb3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:01:57.110778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e2a6-5bb6-4381-ac9d-c790981bb3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:01:57.120254 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e2a6-5bb6-4381-ac9d-c790981bb3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:01:57.121749 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e2a6-5bb6-4381-ac9d-c790981bb3d2 service cinder] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:01:57.131579 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1443/2891] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:02:06.325630 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:06.348788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:06.390990 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905aa63-c168-4fab-affe-dcb1f99fec9c None None] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:06.396293 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:06.397159 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:06.397474 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:06.397757 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] PATH_INFO: `/v3/users/ba95237de6944defa735d9422fb70d66` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:06.398977 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba95237de6944defa735d9422fb70d66)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:06.401020 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:06.624423 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba95237de6944defa735d9422fb70d66'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:06.632407 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba95237de6944defa735d9422fb70d66'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:06.633078 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba95237de6944defa735d9422fb70d66'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:06.633713 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba95237de6944defa735d9422fb70d66'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:06.645968 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba95237de6944defa735d9422fb70d66'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:06.736543 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1449/2892] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:02:06 2022] DELETE /identity/v3/users/ba95237de6944defa735d9422fb70d66 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 17:02:06.741198 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:06.741724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:06.741832 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:06.760772 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] MFA Rules not processed for user `8935c834d03f4a008037c7655781e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:02:06.762103 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:06.820616 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1444/2893] 10.222.0.70 () {58 vars in 957 bytes} [Tue Jun 21 17:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:02:06.830254 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:06.831862 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:06.890866 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c7c3-f00e-4494-beec-92de6851f9ea admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:06.894573 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1097be6c3ab44dd1a3532926235e980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:06.895283 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:06.895506 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:06.895785 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:06.904974 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:06.909223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:06.916160 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1450/2894] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:02:07.371047 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:07.372645 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:07.386278 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7e42f-bf19-4688-82af-e845fc22fba2 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:07.391004 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:07.391875 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:07.392169 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:07.392449 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] PATH_INFO: `/v3/projects/20757c7daaf7423ebc0878f3fe96e41e` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:07.393809 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20757c7daaf7423ebc0878f3fe96e41e)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:07.395722 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:07.515443 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20757c7daaf7423ebc0878f3fe96e41e', 'request_id': 'req-1e3c94ae-3782-4410-9e84-b0fe30648555'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:07.593800 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20757c7daaf7423ebc0878f3fe96e41e', 'request_id': 'req-1e3c94ae-3782-4410-9e84-b0fe30648555'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:07.601570 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20757c7daaf7423ebc0878f3fe96e41e', 'request_id': 'req-1e3c94ae-3782-4410-9e84-b0fe30648555'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:07.613154 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] The token cache is being invalidate because project 20757c7daaf7423ebc0878f3fe96e41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:02:07.613478 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:07.614123 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-1e3c94ae-3782-4410-9e84-b0fe30648555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:07.615724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1445/2895] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:02:07 2022] DELETE /identity/v3/projects/20757c7daaf7423ebc0878f3fe96e41e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:02:16.911822 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:17.610136 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:22.406846 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:22.408251 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:22.499766 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb489bf-98eb-44d7-a7df-aab19f696f7a service neutron] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:22.560223 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:22.560875 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:22.561163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:22.561490 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:22.563277 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:22.574697 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:22.576280 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:22.587050 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1451/2896] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:02:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:02:24.176939 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] REQUEST_METHOD: `POST` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:24.177488 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:24.177610 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:24.236405 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.auth.core [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] MFA Rules not processed for user `2d8f0f57e4e8406dbab4cbcbe9836267`. Rule list: `[]` (Enabled: `True`). {{(pid=80610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 17:02:24.237778 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:24.307731 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1446/2897] 10.222.0.70 () {58 vars in 967 bytes} [Tue Jun 21 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 17:02:24.347926 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:24.349553 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:24.426637 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=100 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:24.440520 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d6d1-56d2-4c13-862a-e396bbfa750e service placement] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:24.445546 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3bfddef4664aad9d210fbeb52acda9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:24.446204 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:24.446502 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:24.446788 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:24.454980 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:24.456682 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:24.465026 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1452/2898] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Jun 21 17:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 17:02:32.618991 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:32.620473 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:32.635737 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d546b-c3c8-4b5a-b035-51bfb71b2af4 None None] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:32.640665 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:32.641360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] REQUEST_METHOD: `GET` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:32.641652 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:32.641932 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:32.644438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:32.656929 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:32.658644 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:32.670871 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1447/2899] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:02:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:02:32.770335 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:32.771797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:32.838896 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5d903-2fc3-4834-8d04-b587c1604fbb service swift] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:32.843346 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:32.844163 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:32.844454 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:32.844733 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] PATH_INFO: `/v3/users/6e403ec2e4684b8eb884e9aefae351d3` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:32.845917 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e403ec2e4684b8eb884e9aefae351d3)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:32.848399 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:33.110197 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e403ec2e4684b8eb884e9aefae351d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.118333 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e403ec2e4684b8eb884e9aefae351d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.119063 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e403ec2e4684b8eb884e9aefae351d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.119797 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e403ec2e4684b8eb884e9aefae351d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.132963 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e403ec2e4684b8eb884e9aefae351d3'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.233284 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1453/2900] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:02:32 2022] DELETE /identity/v3/users/6e403ec2e4684b8eb884e9aefae351d3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:02:33.486551 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:33.500441 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df1e5f-c878-4b92-8d28-721c6949b97c service placement] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:33.559168 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:33.560032 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:33.560325 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:33.560605 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] PATH_INFO: `/v3/projects/30d08b848eb54ba9855407bcdef52d14` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:33.561810 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d08b848eb54ba9855407bcdef52d14)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:33.563704 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:33.692534 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:33.695360 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d08b848eb54ba9855407bcdef52d14', 'request_id': 'req-3f3930f5-5142-43ee-90fe-827a655cbd8b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.756453 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d08b848eb54ba9855407bcdef52d14', 'request_id': 'req-3f3930f5-5142-43ee-90fe-827a655cbd8b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.762275 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d08b848eb54ba9855407bcdef52d14', 'request_id': 'req-3f3930f5-5142-43ee-90fe-827a655cbd8b'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.773781 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] The token cache is being invalidate because project 30d08b848eb54ba9855407bcdef52d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:02:33.774075 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.774724 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:33.776263 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1448/2901] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:02:33 2022] DELETE /identity/v3/projects/30d08b848eb54ba9855407bcdef52d14 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:02:33.780316 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:33.781888 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:33.795446 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbeb58-09ca-4ee0-b9f3-174481d25cce admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:33.852011 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:33.852881 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:33.853167 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:33.853482 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] PATH_INFO: `/v3/users/12ef6f4e7560499db2e37478ff314e0c` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:33.854657 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ef6f4e7560499db2e37478ff314e0c)` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:33.856584 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:33.858882 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:34.075411 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ef6f4e7560499db2e37478ff314e0c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.082618 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ef6f4e7560499db2e37478ff314e0c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.083337 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ef6f4e7560499db2e37478ff314e0c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.083942 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ef6f4e7560499db2e37478ff314e0c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.097255 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.notifications [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ef6f4e7560499db2e37478ff314e0c'} {{(pid=80609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.193443 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1454/2902] 10.222.0.70 () {58 vars in 1223 bytes} [Tue Jun 21 17:02:33 2022] DELETE /identity/v3/users/12ef6f4e7560499db2e37478ff314e0c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:02:34.458024 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Authenticating user token {{(pid=80610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:02:34.459568 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.fernet_utils [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:02:34.478142 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3930f5-5142-43ee-90fe-827a655cbd8b admin admin] Validating token access rules against request {{(pid=80610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:02:34.538461 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935c834d03f4a008037c7655781e212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5dc23437bc45dfae144cb9e387649c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:02:34.539330 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:02:34.539615 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:02:34.539974 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] PATH_INFO: `/v3/projects/1375438233074ed88843ce0951322326` {{(pid=80610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:02:34.541200 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1375438233074ed88843ce0951322326)` {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:02:34.543194 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] RBAC: Authorization granted {{(pid=80610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:02:34.646664 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1375438233074ed88843ce0951322326', 'request_id': 'req-558ceb20-b7a9-46e8-b24a-345e217a6603'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.713228 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1375438233074ed88843ce0951322326', 'request_id': 'req-558ceb20-b7a9-46e8-b24a-345e217a6603'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.719227 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1375438233074ed88843ce0951322326', 'request_id': 'req-558ceb20-b7a9-46e8-b24a-345e217a6603'} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.730438 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] The token cache is being invalidate because project 1375438233074ed88843ce0951322326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 17:02:34.730732 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.731372 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG keystone.notifications [None req-558ceb20-b7a9-46e8-b24a-345e217a6603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 17:02:34.732916 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: [pid: 80610|app: 0|req: 1449/2903] 10.222.0.70 () {58 vars in 1232 bytes} [Tue Jun 21 17:02:34 2022] DELETE /identity/v3/projects/1375438233074ed88843ce0951322326 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 17:02:44.188989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:44.727485 dv-cinder-799871-21-iscsi devstack@keystone.service[80610]: DEBUG dbcounter [-] [80610] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:07:47.677989 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Authenticating user token {{(pid=80609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 17:07:47.679481 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:07:47.754629 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5566b8-928f-4104-acb8-83ae82bd401e admin admin] Validating token access rules against request {{(pid=80609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 17:07:47.814711 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5976deb8abc4c04b60380fa27703c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3416d28217fe44a494d525a56e6508f6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 17:07:47.815359 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] REQUEST_METHOD: `GET` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 17:07:47.815647 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] SCRIPT_NAME: `/identity` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 17:07:47.815928 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 17:07:47.817844 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.fernet_utils [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 17:07:47.829010 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 17:07:47.830639 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520c840-a91d-4a8f-b708-ef772b0a9b8a service placement] RBAC: Authorization granted {{(pid=80609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 17:07:47.840523 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: [pid: 80609|app: 0|req: 1455/2904] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Jun 21 17:07:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 17:07:57.836308 dv-cinder-799871-21-iscsi devstack@keystone.service[80609]: DEBUG dbcounter [-] [80609] Writing DB stats keystone:SELECT=58 {{(pid=80609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}